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Abstract 

During interaction with virtual or remote environments, a person may 
benefit iFrom the addition of tactile or force feedback to the ubiquitous visual 
feedback. However, the apparatus required for reactive feedback (feedback 
which imposes the remote environment's motion-constraints on the user by 
applying joint torques) is cumbersome and expensive, especially M^en imple- 
mented in conjunction with high degree-of-freedom precision joint motion 
sensing. Non-reactive, tactile feedback can provide similar information, and 
can be implemented at much lower Cost The purpose of this research was to 
design, demonstrate, and test a feedback system to determine the extent to 
which such tactile feedback aids in task perfonnance. 

After preliminary design, and experimentation with several display 
technologies, a 250 Hz vibrotactile display was designed in detail. 
Experimental investigation of the display's use showed that, during a virtual 
environment tracking task in which the thumb and index finger were used si- 
multaneously, it provided a small but statistically significant perfonnance 
increase over visual feedback alone. The vibrotactile display could also be 
substituted for a visual display when the latter was unavailable or degraded. 

Research (performed using the author's tactile feedback apparatus) is 
cited to show that non-reactive, tactile feedback can confer almost as much 
improvement over visual feedback alone as can certain types of reactive force 
feedback. Research is also cited to suggest that when a transmission delay is 
present during teleoperation, instability may be avoided by using a tactile, in- 
stead of a reactive, display. 

Finally, a subjective workload measure (NASA's TLX) was evaluated as a 
replacement for measured task performance. Such a subjective measure might 
be used in evaluating display combinations if performance were difficult to 
measure. NASA's TLX was found to be a satisfactory measure of perfomiance. 

Thesis Supervisor: Professor Thomas B. Sheridan 
Professor of Mechanical Engineering and Applied Psychology 
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di Distance of index-finger from zero calibration position mm 

dii-dis Components of di due to each index-finger phalanx mm 

dt Distance of thmnb tip from the zero calibration position mm 

dti-dt3 Components of dt due to each dimnb phalanx mm 

e Error, diff, between input and output in a control system 

eb Sum of mean errors in thumb and index-finger tracking mm 

ei Mean error in index-finger tracking mm 

en Normalized tracking error, - Cb/mp 

Cp Mean diff. between plate thickness,w, & its average, Wav mm 

et Mean error in thxmib tracking nmi 

/ Rate at which the thickness of the virtual plate is changed Hz 

Id Index of Difficulty in Htts tapping task experiment bit 

lil-li3 Lengths of first, second, & third index-finger phalanges mm 

lti-lt3 Lengths of first, second, & third thumb phalanges mm 
MAxocxjOT Number of software cycles in one trial 

mp average change of the plate thickness per second mm/s 

n Sample size 

r Reference input to a control system 

RE Remote Envirorraient 

t Student t-test value 

Tic Tactile display: compensatory, on-off 

T2C Tactile display: compensatory, half-range, non-linear 

Vic Visual display: conq)ensatory, on-off 

V2C Visual display: compensatory, half-range, non-linear 

V3P Visual display: pursuit, full-range, linear 

VE Virtual Environment 

w Instantaneous thickness of virtual plate (thick in handSl.c) mm 

Wav Average thickness of the virtual plate mm 

y Output from a control system 

©0-07 Joint angles of thumb and index finger rad 

p. Mean of normalized errors from several trials 

a Standard deviation of normalized errors from several trials 
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1 Introduction 



In this chapter the need for tactile feedback is explained The reader is 
then given an overview of the senses which are involved in touch, since they 
are so important to the designer of a tactile feedback system. Finally, some 
tactile and visual displays are discussed according to classifications suited to 
the emphasis of this research. 

1.1 The Need for Feedback of Force and Tactile Information 

During our everyday interactions wifli our environments, we receive in- 
formation through a variety of sensory systems, among them are vision, hear- 
ing, and touch. It is for diis reason that the degree to which all of these senses 
are employed in providing feedback is so important in determining the realism 
of a simulation. For instance, modem flight simulators obtain their realism 
by providing visual information through all of the cockpit windows; audio 
information of engine noise and alarms; tactile infonnation through a control 
stick and switches; and vestibular infonnation via the tilting of the cockpit 
To quote Taylor et aL [1973]: 

"Correlative information from three or four senses 
yields a much more stable perceptual experience than 
does information from a single sense unsupported by 
independent corroboration..." 

It is therefore not unreasonable to predict that interaction with virtual 
or remote environments is rendered more realistic by the addition of tactile 
feedback to die usual visual feedback* In fact, there are three principal areas 
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in which we might benefit from the development of systems to provide such 
tactile feedback : sensory substitution, virtual enviroimient (VE) interaction, 
and remote enviroiiment (RE) interaction, i.e. teleoperation. Of Aese three 
areas, teleoperation has offered the most inspiration to designers of tactile or 
force feedback systems, as we will see later. 

lA.l Sensory Substitution 

When a sense is lost or impaired, the information it normally transmits 
may be provided via another sense. For instance, many blind people read 
Braille, they substitute their sense of touch for their sight. Sensory substitu- 
tion has bwn defined by Bach-y-Rita et aL [1987] as: 

"The provision to the brain of information that is 
usually in one sensory domain^ by means of the recep- 
tors^ pathways^ and brain projection, integrative^ and 
interpretive areas of another sensory system," 

Sensory substitution is not only useful to the invalid: one non-clinical 
application is found iii a device to help astronauts perform delicate tasks while 
wearing a space-suit glove. The pressurized glove is bulky and stiff, render- 
ing the astronaut's hands effectively insensate. To overcome this problem^ 
Tan and Zhu [Webster, 1988] applied 16 pressure sensors to the palm and fin- 
gers of flie outside of a space-suit glove, and used signals from these sensors to 
drive 16 electrodes worn against the operator's waist. After some training, 
subjects were able to leam more complex tasks, discriminate more complex 
objects, and detect objects with lower grip forces with this electrotactile feed- 
back apparatus than without. The subjects reportedly found the electrotactile 
feedback comfortable. 
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A disadvantage of feedback systems which ^ploy sensoiy substitution 
is that they require some training before they can be used adroitly. 
Obviously, a desirable (aldiough not necessary) attribute of any conmiercial 
feedback system is that if s use be intuitive: it should provide information to 
the user in as natural and easily-learned a manner as possible. 

1.1.2 Teleoperati on 

The most common area in which feedback of force and tactile feedback 
are put to use is teleoperation. The bilateral^ master-slave manipulator (MSM) 
has been used for decades [Johnsen & Codiss, 1971]. It has, for instance, 
helped nuclear power-plant workers handle radioactive materials which 
needed to be kept safely away from them on the odier side of a thick window. 

With the lecent development of more anthropomorphic end effectors 
for telerobots, like the Utah/MiT [Jacobsen et aL, 1986] and Stanford/JPL 
hands, a new breed of high degree-of-freedom input devices, like the EXOS 
DHM, has emerged. Such devices, capable of measuring all of the human 
hand's joint motions, while confomiing to the most subtle of the hand's 
motions have placed new demands on die designers of feedback systems. It is 
much more challenging and expensive to apply feedback forces to every finger 
of the hand, over a large range of possible motions, than it is to provide 
feedback to two fingers which move in a straight line through a few inches, as 
is the case with the older MSM's. For this reason, the tactile feedback offered 
by simple fingertip displays is a very attractive alternative to reactive force 
feedback. 



1 The word bilateral refers to the force-reflecting ability of the MSM 
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1.1.3 Virtual Environment Interaction 

An area which has seen enormous growth in recent years, due to die 
meteoric rise in computer power, is virtual reality. Flight simulators, video 
games, and virtual laboratories are all much more realistic than ever. Yet in- 
teraction with them is sometimes limited since an operator usually only re- 
ceives visual information from them. This situation is changing: modem 
flight simulators have what amounts to a vestibular display: the hydraulic ar- 
ray which can tilt the cockpit to simulate accelerations. Interaction wifli other 
virtual environments can likewise benefit from the addition of feedback 
through other sensory modalities. For instance, a person interacting with a 
virtual sculpture would be more overwhelmed by the simulation if he could 
feel as well as see his work taking shape. However, foice-teflecting master- 
slave systems, which can easily be reconfigured (minus the slave) to accom- 
modate VE interaction are very expensive and cumbersome. VE systems must 
be inexpensive if they are to catch on, and providing tactile feedback is an in- 
expensive alternative to providing reactive feedback 

The tfaesiis upon which this research is based is that tactile feedback 
mig^t be substituted for reactive force-feedback in both VE and RE syst^s, to 
provide most of the increase in performance at a fraction of the cost 

1.2 The Scn.ses of Touch 

The sensors that give us a sense of touch can be divided into two groups: 
diose that react to stimulation of the body's surface (the exteroceptors in- 
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volyed in cutaneous sensation), and ttiose that encode the position of, and mus- 
cular forces within, the body (the interoceptors involved in proprioceptionO. 

1.2.1 Exteroceptors (or Cutaneous Sensors) 

Tliere are three types of receptors in the glabrous^ skin of the human 
hand: thermoreceptors (which transduce temperature changes), nociceptors 
(which transduce noxious stimuli to produce pain), and mechanoreceptors 
(which transduce mechanical stimuli). Of these, only the mechanoreceptors 
will be considered here, since they are the most important for touch. Table 
1.2.13 below summarizes the characteristics of the four mechanoreceptors. 
The receptors arc classified by the speed with which they adapt to a mechani- 
cal stimulus, rapidly (RA) or slowly (SA), and the frequency at which their 
thresholds are lowest, /miiu thresh.* Is given. Information about &e spatial 
resolution of the receptors is also tabulated. The deeper receptors can be seen 
to have larger areas over which they will respond to a stimulus, and hence to 
have lesser abilities to resolve the stimulus in space. 



Type 


RAI 


RAil 


SAI 


SA II 


Ending 


Meissner 


Pacinian 


Merkers 


Ruffini 


Corpuscle 


Corpuscle 


Complex 


Cylinder 


Adaptation 


rapid 


rapid 


slow 


slow 


/ min. thresh. 


8-64 Hz 


250 Hz 


-OHz 


-OHz 


Location 


shallow 


deep 


shallow 


deep 


Mean receptive area 


13nvn2 


101 mm2 


11nw2 


159 mm2 


Spatial Resotutton 


poor 


very poor 


good 


fair 



Table 1,2.1: Characteristics of Cutaneous Mechanoreceptors 



1 Pjroprioception refers to the sense of posture and movement, and includes the vestibular 
sense. Kinesthesisrefers to the sense ofposidon and movement of the limbs. I shall use 
the more general tenn, propriocepdon, tboughouL 

2 Glabrous skin is haMess, ridged skin, like that which covers the fingertips. 

3 Adapted from Led^man and Browse [1988]. p.76. 
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The SA mechanoreceptors, which have the highest spatial resolution, arc 
the primaiy sensors used during edge detection, which is thought to be impor- 
tant during object manipuhitiou and identification [Lederman & Browse, 
1988]. They are also the primaiy sensors for tiie reading of Braille. Lateral 
inhibition^, which is so important in edge-enhancement in the eye, may also 
play a part in tactile edge recognition. However, smce there are no lateral in- 
terconnections in the periphery of the cutaneous sensory system, either the 
skin itself peiforms this function, or it is performed neurally in tfie afferent 
fibres beyond the first synapse. The RufFini cylinders are thought to play a 
part in transducing lateral deformations of the skin, which may be important 
in the perception of the weight of an object 

Clearly, it is the Pacinian corpuscle which plays the major role in trans- 
ducing vibration, particularly at the higher frequencies. Its lower spatial reso- 
lution should be of concern to the designer who is intent on providing 
feedback with the ability to resolve fine detail. However, many commercial 
feedback systems make use of vibrational stimuli to convey quite fine spatial 
detail. Among these, the Optacon tactile refresbjible display for the blind 
(Telesensoiy Systems, Inc., -] uses a camera to capture images which it then 
displays using 144 pins which vibrate against the distal flange of the finger. . 

It is impoitant to note that human sensory performance is not the result 
of single-fiber responses, rather it is the result of a synthesis of the responses 
of a population of fibers. For example, a single Pacinian corpuscle responds 
to increasing stimulus amplitude in a series of ramps and plateaus, whereas die 



1 Lateral inhibition is an edge-enliancement mechanism found in the eye in which adjacent 
optical receptors inhibit each others signals in proportion to their own levels of stimulation. 
In this way, the contrast between light and dark areas of an image is accentuated. For de- 
tails see Barlow & MoUon [1988] pp. 22-24. 
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human obseiYefs estimate of the amplitude increases linearly (Parian-Smith, 
p. 769] since he is combining the signals from many corpuscles. 

The ideal tactile feedback system would excite all of these cutaneous re- 
ceptors in die eiqiected manner, so as to provide the user with realistic sensa- 
tions. 

1.2.2 Interoceptors (or Proprioceptors) 

Information about the configuration of and forces within the body is 
provided by proprioceptors: by sensors in the muscles, called muscle spindles, 
which measure die length and rate of contraction of muscles; by joint recep- 
tors, Ruffini endings (SA mechanoreceptors) which measure joint angles and 
paciniform corpuscles (RA mechanoreceptors) which measure angular rates; 
by golgi tendon organs, which measure toidon forces; and also by cutaneous 
receptors. Table 1.2.2, below summarizes these internal mechanoreceptors. 

Location Joint Joint Tendon Muscle 

Ending Ruffini PadnRonn Golgi Tendon Muscle 
Ending Coipuscle Organ Spindle 

Adaptation SA RA - - 

Table 1.2.2: Joint and Muscle Mechanoreceptors 

In the interphalangeal joints die dueshold for the detection of changes m 
joint angle due to passive movement is about 1.2**, and die threshold for the 
detection of angular speed is about 107s. These are much larger thresholds 
dian those found for the proximal joints. 

Li practice, the distinctions between interoception and exteroception are 
not as clear as the definitions given above imply. For instance, cutaneous sen- 
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sors are involved in the measurement of the angles of distal joints like the in- 
terphalangeal joints: as the finger is flexed to its limit, SA receptors in the 
skin of the finger fire in response to the skin's stretch [Darian-Smitfa, -, p. 
781]. It is interestxQg to note that joint receptors and cutaneous recq>tois are 
thought to play a much larger role in the measurement of angles in these distal 
joints than in proximal joints (like the Mp), where muscle receptors are the 
dominant contributors to position sense. 

1.2.3 Cutaneous Sensors vs Proprioceptors for Grasping 

During the grasping of an object, it is necessary to apply forces to the 
hand at the fingers, in order to subject the uitemal stracture of the hand to any 
loads. Since the fingers and the hand have finite dynamic diaiacteristics (e.g. 
mertia, stiffness, etc.) there is a tune lag in the reception of these different 
signals by the relevant sensors. There is also a difference in the change in 
signal sizes for cutaneous sensation and proprioception during contact wifli an 
object. The cutaneous senses are not excited during rigid-body motion of the 
fingers, and when contact is made with an object, the cutaneous signals jump 
to values which arc significantly larger than zero. The intemal sensors, on the 
other hand, have been signalling the skeletal forces and motions which always 
accompany movement, and ttie extra forces and motion constraints which 
contact imposes have a much smaller effect on their signals. In other words, 
cutaneous sensation is a necessary precursor to proprioception, and the 
cutaneous receptors are more sensitive to contact than the proprioceptors. 
Thus, touch may play the more important role in grasping. 
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.1.2.4 Touch versus Vision 

We have concentrated on describing the senses of touch, but no study in 
which touch and vision are to be compared can ignore the abilities of vision. 
For instance, vision is superior to haptic touch^ for object recognition, and 
when touch and vision are in conftict, vision prevails [Welch and Wanen, 
1986]. 

On the odier hand, response to tactile signals is faster than to visual sig- 
nals. Welch and Warren [1986] report that, in man, visual reaction time is 
about 150 ms, whereas response to a tactile stimulus takes about 110-120 ms. 
This signiticantly longer time for response to a visual stimulus is usually 
attributed to the processing that takes place in die retina. Pierce [1980] cites 
experiments in which a subject must respond to a stimulus by depressing one 
of several buttons. The subjects responded to a tactile stimulus at the finger 
more quickly than to a visual stimulus. This was due in part to the greater 
speed of response to a tactile stimulus, and also in part to the proximity 
between the stimulus and the responding motor system (both stimulus and 
response were in the hand). 

Both senses seem to have tiieir strengdis: touch is faster, and vision is 
more compelling. It would seem important that any stimuli provided by a 
tactile display should not be in conflict with those provided by a visual display, 
or the expected benefits might disappear. 

Once it has been determined that tactile information might be a benefi- 
cial adjunct to visual information, die problem is reduced to one of determin- 
ing how best to provide such tactile information to the human user. 



1 Haptic touch is toudi combined with grasping and manipulating by the hand. 
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1.3 A Taxonomy of Displays 



Displays may be divided into, among others, the following categories: 
pursuit vs. compensatory, full- vs. half-range, and discrete vs. continuous. 
Tactile displays may be further divided into reactive and non-reactive cate- 
gories. The following are brief explanations of each of these distinctions. 

1.3.1 Compensatory and Pursuit Displays 

Sheridan and Ferrell [1981] provide the following definitions of com- 
pensatory and pursuit displays. A comp^isatoiy display is one in which the 
operator is provided with a single input, the error e, which is the difference 
between the ou^ut, y, and the reference, r. A pursuit display is one in ^ich 
the operator is provided with both the reference input, r, and the ou^Ut, y; or 
equivalently both the input and the error. With both signals he may dis- 
tinguish their individual properties by direct observation. Figures 1.3.1 (a) 
and (b) show compensatory and pursuit displays respectively. 

Many visual displays are pursuit in nature (many are even preview or 
precognitive). For instance, in reaching for a moving target a person has a 
view of the target's dianging location in space, and is also aware both visually 
and proprioceptively, of the location of his hand. Error, and thus required 
movement, is obtained by combining the two. 

When there is contact, normal grasping might be considered a pursuit 
activity, since output, y, is proyided by the subject's proprioception, and in- 
fonnation about tbe error, e, is provided by the mechanoreceptors in ttie skin 
and joints. Nevertheless, I have chosen to follow convention and consider the 
tactile displays compensatory during grasping because (a) the information 
about the error and the output comes from the user's interoceptors, not from 
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an external display via his exteroceptors, (b) information about Uie input, r, is 
not provided directly, it must be leconstrocted from the ou^ut and the error, 
and (c) with a non-reactive tactile display, the user's motion is not constrained 
by the object being grasped, perhaps rradering propriocq)tion uiueliable. 




(a) compensatory (b) pursuit 



Figure 1-3.1: Compensatory and Pursuit Displays 

1.3.2 Full-Range and Half-Range Displays 

A display may operate over flie whole range of input or error (distance 
between effector and target), or it may only provide a signal when the error is 
negative (i.e. when contact is made). This half-range behavior is the norm 
during grasping: we have no cutaneous sense of proximity (unless the object 
is radiating heat) and must wait until contact is made to receive tactile 
information with which to modify our grasp. Hgures 1.3.2 (a) and (b) show 
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display profiles, i.e. stimulus (provided to the user by the display) versus dis- 
tance^, for full* and half-range displays respectively. 

It is possible to provide fuU-range coding of touch if proximity to an 
object can be measured. In teleoperation, for example, this information may 
be provided by infra-red proximity sensors at the slave fingertips; and in VE 
interaction this information may simply be computed. Such coding might 
prove beneficial, but would require additional learning. 




(a) (b) (c) 

full-range half-range on-off 

linear non-linear 



Figure L3,2! Display Profiles: Amplitude versus Distance from Object 

1.3.3 Binary and Continuous Displays 

A display may provide a contiuuous stimulus to the user, as a convene 
tional altimeter displays altitude, or it may provide a binary stimulus, as does 
an annunciator light or a whistle. Altematively it may have several discrete 
levels of signal. Figures 1.3.2 (a) and (c) show stimulus against distance for 
continuous and binary displays respectively. 

1 Distance, d^ is measured fix>m the fingertip to the object in question, and is positive when 
the fingertip is outside the object 
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1.3.4 Reactive and Non-Reactiye Displays 

i shall use Uie tenns teactive and ncm-reactive to distinguish between 
displays which do and do not apply die physical constraints to motion of the 
remote mvironment (or the V£) to the user's input motions; forcing and non^ 
forcing to distinguish between di^Iays which do and do not apply steady force 
to the extremities of die body. 

A bilateral master-slave manipulator provides a reactive display of RE 
force-information at the master, thus applying the constraints of the RE to the 
user's input motions. However, a non-reactive, tactile display places no such 
restricti(ms on the user's input motions, and is thus potentially conjfosing to the 
user, who may now place his hand 'inside' a virtual object while still being 
provided with information about ^t objects exterior througih his cutaneous 
senses. Herein lies On Of the greatest potential pitfalls of the non-reactive dis- 
play. 

la contrast, a joystick which is spring-centered to provide feedback of 
input motion via force is not considered reactive, since it provides no infor- 
mation about the force applied at the slave end-effector. 

1.3.5 Notation 

For clarification and abbreviation, the notation in Table 1.3.1 will be 
used to describe die different displays and display profiles. 

Thus, V2C is a half-range, non-linear, compensatory, visual display. 
Refer to Figures 1.3.2 (a) (b) and (c) for illustrations of die display attributes 
labelled 3, 2, and 1, respectively. 
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Abfaieviatiqn: 


Display Attribute: 


V.T,orR 
3, 2, l,orO 

pore 


Sensory CSuumel: A^ual, Tactile, or Reactive. 
Profile: Full-range linear. Half-range Noa*linear, 

Qn-off, or None, respectively. 
Pursuit or Compensatory. 



Table 1.3.1: Display A bbreviations 



The reader should bear in mind that these tactile displays could, of 
course, be used to display force instead of position to the operator. In teleq)- 
eration, it would be more convenient to use tactile displays to convey force in- 
formation as obtained with force transducers at the slave fingertips. There is 
a natural relationship between displacement and force, since objects typically 
have a force-deflection characteristic (or stiShess) wi& which die operator 
may associate the infoimation from the display. However, for the purposes of 
this research, the tactile displays were used to provide distance information 
(i.e. a display stimulus proportional to penetration into UtiG object) to the user. 
Thus, tactile and visual displays were conveying similar information, making 
dieir comparison easier. 
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2 Design 

In this section the benefits of, and constraints imposed by» the EXOS 
Dextrous Hand Master (DHM) are explained; preliminary design of the display 
is discussed; and the detailed design of a vibrotactile display, display electron- 
ics, and software is explained. 

2.1 The EXOS PCTtrows Hand Master 

In order to provide commands to a remote or virtual manipulator, some 
form of input device, or human operator interface, is required^ During dex^ 
trous operations, it is often easiest to measure the position of tiie human hand, 
and use this information to control a dextrous end-effector directiy. For this 
research, real-time measurement of the hand's joint angles was crucial* 

For this purpose, a tv/o-fingered DHM was kindly provided by EXOS 
Inc. of Burlington, Massachusetts^. It brought widi it many important design 
considerations, both braefits and constraints. 

The DHM is intended primarily for accurate control of dextrous robotic 
hands like the UtahMiT Hand, and for hand-joint measurement in medicine 
and human factors [Marcus et al.^ 1989]. Its superior accuracy make it ideal 
for the control of both robot hands and virtual hands. A rival product, the 
VPL DataGlove^, while lighter and more comfortable to wear, lacks the preci- 
sion required for more than simple gesturing tasks. The DHM uses Hall-effect 



1 For info., contact EXOS Inc., 8 Blanchard Rd, Burlington, MA 01803, (617) 229-20'75. 

2 The DataGlove measures joint angles by measuring tniciobending losses of light in optical 
fibers strung along the backs of each of the fingers [Foley, 1987]. 
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Sensor for Proximal 

tnterphalangeal Joint Spring CT^ Mount 




FigTire 2.1.1: Part of an EXQS DHM on an Index Finger 

sensors mounted in linkages above each joint to measure joint angles indi- 
rectly. A diagram of part of the DHM worn on an index finger is shown in 
Rgure 2.1.1, above. 

In order to maintain a constant geometric relationship between the sen- 
sor linkages and the phalanges, the DHM makes use of aluminum V-blocks, 
which are held firaily to tfie backs of the fingers by spring clips. These blocks 
and the sensor linkages consume most of the real-estate on the backs of the 
fingers and hand. For this reason a tactile display which makes little or no use 
of this area is required. 

Anodier potential problem to be considered when providing feedback in 
conjunction with the DHM is the possibility that the actuation of the display 
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element might move the DHM's sensors. This might result in oscillation or 
divergence of the display signal. 

2.2 Preliminary Design and Display Element Choice 

In the design of a tactile or reactive feedback system there are many av- 
enues one may take. The following is a smnmary of some of the more inter- 
esting displays, with their benefits and problems. It is followed by the design 
choices made for this projecL It is important to bear in mind that, size, cost, 
weight, effectiveness, and complexity are key issues in &e design of a simple 
tactile display. Table 2.2,1 sununarizes some of the qualities which an ideal 
display might possess. 

One of the main objectives in the design of any feedback system must be 
to keep to a minimum tiie amount of sensory substitution employed. Altiiough 
sensory substitution is valuable, even irreplaceable under certain circum- 
stances, its use increases the training time required for an operation. A more 
natural feedback scheme will make use of die lifetime's experience an operator 
has accumulated with his own senses, and will thus require less training. 



1 Property | 


1 kecj^uirements 




5t 1 


1 Should be light enough to wear and transpon 




Should be competitive with visual*<HiIy systems 

Should be much less expensive Aan present reactive displays 


Size 


Should be small en<mgh to wear, without interfering with 
nx)vement, precisicm joint measurraient, clothing etc. 


Nature 


skould avoid the use of sensory substitution 
Should be safe to use for extended periods 
1 Should be compatible with dextrous hand movement 



Table 2.2.1: Some Requirements for a Display 
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2.2.1 From Reactive Displays... 

Proposals for reactive displays are much easier to find than wolldng ex* 
amples! Bergamasco et al. [1989] proposed a reactive *dataglove* for their 
biomedical teleoperator. It was to provide joint torques to a physician's hand 
using tendons strung along the backs of the fingers. However, sizeable fin- 
gertip forces can only be applied by relatively large tendon forces, which may 
have undesirable effects. For instance, they may act to compress the fingers, 
and thus may provide conflicting cues to the operator. 

It would seem that an exoskeleton of some sort would be required to 
resist all of the undesirable forces* Jacobsen et al. [1989] have designed and 
bunt a 9 d.o.f. exoskeletal input device which is capable of providing reactive 
force feedback. It uses hydraulically actuated antagonist tendon pairs for 6 
d.o.f„ direct hydraulic actuation for die other 3, and makes use of an ex- 
oskeletal structure. The cost of their 9 d*o.f. system, at about $1000 per 
d.o,f,, is an order of magnitude more expensive than the non-reactive vibro- 
tactile system developed for diis thesis, which cost about $S0-$100 per d.o.f. 

Reactive force displays are also at a disadvantage where weight is at a 
premium, for instance in space-based teleoperation. The hand mounted com- 
ponents of the reactive system of Jacobsen et al., sans computer, reportedly 
weighs several pounds. As will be seen later, a vibrotactile system, also sans 
controlling computer, can eiasily be under 1 oz^ iper do.f. 

Another important problem associated with reactive displays is that they 
contribute directly to instability in teleoperated systems where there is a 
transmission delay. Ferrell [1966] suggests the use of auditory, visual, or 



1 A single vibrotactile display dement, as used in this research, weighed less than 1 oz, and 
the piezo-electric actuator motioned below weighed even less. 
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particularly tactile displays of force to remove the diahce of instability in such 
syst^ns. 

It is clearly time to consider non-reactive displays! 

2.2.2 ... to Non-Reactive Displays 

Leighton & Woimley [Sheridan & Ferrell, 1969] devised an "Air Jet 
Touch Display" using a 3-by-3 array of air jets aimed against the fiagertip» 
and they reported that their human subjects had no difficulty recognizing 
changing patterns with the device. 

Foley [1987] reports that VPLi have woiked on three tactile display 
technologies: (1) solenoid-actuated blunt vares, which are pushed against the 
skin of the finger tips; (2) piezo-electric crystal vibrotactile display elements; 
and (3) a memory metal display, in which ihe metal elements are heated by an 
electric current, change shape, and press upon the skin. Little can be said 
about the success of any of these approaches, since VPL have neither published 
their work nor marketed any tactile feedback products. 

Calder [1983] examined the possibilities of an electrostatic actuator, and 
a solenoid-array actuator, before finally settling on a pneumatic design. 
However, one of his requir^ents had been to provide toucb actuation to the 
human hand, ^ile at the same time being able to measure forces applied by 
tiie hand. This additional requirement complicated his design somewhat 

A pneumatic-bladder design for an actuator with a small display elonent 
was considered in this study. A sketch of such a design is shown in Figure 
2.2.1, below: the bladder on the back of the finger could be inflated to drive 
the display element into tiie pad of the finger, and although the forces on the 

1 VPL Research Ixic., Redwood Gty, CA, specializes in products fm interacdoa mth viitoal 
realities. 
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back and front of the finger must be equal, the bladder would exert less 
pressure, and thus elicit less sensation. The device has many advantages: it is 
light and applies force to the fingertip, minimizing sensory substitution. 
However, like Caldei's design, it would interfere with the DHM on the back of 
die finger, and might cause instability or divergence of die display signal. 



Pneumatic 



Bladder 




Qement 



Figure 2.2.1: A Pneum atic Actuator Design Concept 

Direct stimulation of the central nervous system (CNS) offers some in- 
teresting possibilities. Barlow and Mollon [1988] report that direct electrical 
stimulation of the primaiy somatos^oiy cortex^ can elicit sensations of, inter 
alia^, movement, surface-touch, and vibration. Suiprisingly, there is almost 
no pain reported by subjects receiving such stimulation. This mediod of feed- 
back offers some interesting possibilities for future woik, but is clearly im- 
practical for an inexpoisive device, and is beyond the scope of diis diesis. 

Electrocutaneous stimulation, Uke that used by Tan and Zhu [Webster, 
1988] on the space-suit glove, or by Blamey and Claik [1985] for their 

1 A part of the brain's cerefaral cortex. 

2 ItOer alia is Latin f<x among other things. 
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electro-taetile speech processor (the Tickle Talker*') for the deaf, is attractive 
because of its light weight, size, and low power lequircmenL However, some 
painful preliminary experimentation convinced the author that the range of 
stimulus between threshold and pain was too small for anything but a binary 
display, hiterestingly. Blarney and Clark [1986] quote a fair dynamic range of 
15 dB, or 5.6, in their patent application. 




Layered 
PVDFnim 



Figure 2.2.2: A Piezo- Hlectric Actuator Design Concept 



The author's first experiments with vibrotactile displays were with 
Kynar® Piezo Filmi, a piezo-electric polymer, which can be wrapped into a 
small actuator suitable for use under the fingertip. Figure 2.2.2 shows one 
possible configuration for a PVDF display element The piezo-electric wrap- 
pings contract and expand under the applied AC voltage, and this vibration is 
transferred to the fingertips through the ring. Although light, and low-power, 
preliminary designs for an AC driving circuit^ showed tliat about 1000 volts 



1 Kynar® Piezo Film, made from PVDF or Polyvinylidene Flouride, was obtained from 
Pennwalt Co. 

2 The preliminary driving circuit consisted of a sine-wave generator, an amplifier, and a 
' transformer. 
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were required to actuate the display. Leysieffer [1985], Linvill [1986], and 
others have, however, reported success with PVDF as a vibrotactile actuator. 



Display Technology: 


1 Disadvantages: 


Advantages: 


Tendon and Moux' 1 


* uonqiiex 

• Heavy 
•T1ringu>use 

lilVA'tljpaUUiC WiUl lllj^l 

joirit rneasurenoent systems 


• Realistic for force 

• no sensory suDstitutn 


Air Jet 


• High weight 

• XMoise 

• Large 


• Force fli vibration 


Pneumatic Bladder 


• Incompatible with high d.o.f. 
joint measurement systems 
f uivvo uoin suiwD oi •unger 


• No sensory substitute n 
•Ught 


BiuntWiic 


•Highpow^ 
• Heavy 


• No sensory substitutn 

• Large forces possible 

• Force or vibration 


MeaxnyMetal 


• High power and current 

• Large 


• No sensory substitut'n 

• Large forces possible 


Vibrotactile, voice coil 


•Lowiaiige 
•Senscnyfiadgiie 


•Uglit 

• Low power 

•Small 


Vibrotactile, Fiezo Electric 


• Very low range 

• Sensory fadgue 
•Ifi^ voltage 


•Ught 

• Low power 

•Small 


Electnocutaneous 


• Low range between 

t!ueshold&pam 

• Skin pigment transport 
•Liability 


•Lightest 
•Low power 
•Flexible 
•Smallest 


Stimulation of CNS 


•Intrusive 

• E3cprasive 

• Large liabifity pn^leni 


•As yet unknown 



Table 2.2.2: Advantages and Disadvantages of Several Displays 



However, their designs (like those for refreshable Braille displays) have em- 
ployed mechanical amplifiers which are to bulky for mobile fingeitip displays. 
Bliss et al. [1971] successfully used an array of 48 piezo-electric bimoiph ac- 
tuators to provide force distribution information to the user of a remote ma- 
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nipulator with force feedback. However, the author found that even at the 
high voltages mentioned, the plain PVDF half-ring shown in Figure 2.2.2 vi- 
brated with an amplitude below die threshold of many subjects. 

A hopeful design employed a single vibrating voice coil for each finger. 
Voice coils can produce relatively large-displao^ent vibrations without me- 
chanical amplification, and do not consume much power in the process. They 
are light, relatively small, and their vibratory output cannot interfere with the 
low-frequency hand measurement perforaied by die DHM. Table 2.2.2, above, 
lists some of the advantages and disadvantages of each of the types of display. 

Given all of these design options, and a list of criteria against which to 
judge them, the choice of a display became easier. The purpose of the re- 
search was to build a non-reactive display, so the reactive technologies could 
be discarded. Direct stimulation of the CNS is clearly impractical here, and 
finding experimental subjects is already difficult enough. Of the remaining 
non-reactive technologies, vibrotactile stimulation, specifically with a voice- 
coil display, was die most promising. 

At the finest level of scrutiny, a vibrotactile display employs sensory 
substitution, since excitation of the RA mecluuioreceptors (particularly the 
Pacinian corpuscles) will be substituted for, inter alia, excitation of the SA 
mechanoreceptors and proprioc^tors. However, some degree of sensory 
substitution, or sensoiy dq>rivation, is inevitable if a full-blown reactive and 
cutaneous feedback syst^n is to be avoided. 
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2.3 Design of the Analog Rlggfrnnics 



Having chosen a vibrotactile display, a paiticular display element was 
required. Voice coils were kindly provided by Audiological Engineering, 
Inc., of Somerville, Mass., from their stock of vibrotactile actuators. 

It was necessary to design and build drcuitiy capable of driving these 
voice coils at the desired 2S0 Hz, with variable amplitude commanded in real- 
time from the PC. A frequency of 250 Hz was chosen because tiie RA recqi- 
tors in the skin have the lowest threshold at this frequency. It is not as easy to 
excite the SA receptors since large powers are harder to provide at the low 
frequencies to which diey respond. For diese reasons, experiments with vi- 
brational stimulation of die skin have traditionally used this frequency. 



Function 
Generator 
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Figure 2.3.1: A Schematic of the Analog Electronics 



The final design employed a two-channel, two-quadrant, multiplier 
chip, essentially a two-channel amplifier with a common voltage-controlled 
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gain, to amplify flie signal from a function generator (the gain would be ad- 
justed by an analog voltage from the PC). 

A schematic of flie electronics is shown above in Figure 2.3,1. Two 0-5 
volt, analog signals were available from the DHM's MetraByte DAS-16 data ac- 
quisition board (MetiaByte, 1984]. One was used to control the thumb display 
(A), and one to control the index-finger display (B), These two signals were 
used to modulate the sine-wave output (C) of an Intersil function generator 
chip [Intersil, 1988] on two different channels, to produce two amplitude- 
modulated (A.M.) signals (D) & (E). These A J^. signals were then amplified 
by two LM12 power amplifiers [National Semiconductor, 1989] to produce the 
larger signals (F) & (O) required to drive the voice coils. 

The wire-wrapped prototype pcrf-board required ±12 Vdc power, 
which was provided from a Futaba Power Supply, and produced two channels 
of A.M. signal to drive the displays. A more detailed and conventional circuit 
schematic and a board layout diagram are to be found in Appendix A, along 
with a parts list and performance characteristics for the circuit 

After preliminary testing, the peif-board was packaged in a 7"x7"x2" 
aiummum enclosure, and components like the connectors, tiie switch, and die 
LED were moved from the board to this enclosure. A photograph of the en- 
closure and perf-board is shown in Appendix A, Figure A.1. 

2.4 DMiOTi of thg Software 

The first task was to write software to test tiie hardware: adte5t.c was 
written to test the MetiaByte board and flie DHM togetiier, datest2.c was writ- 
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ten to test the ou^uts of the MetraByte board which were used to drive the 
vibrotactile displays. Both are listed in Appendix B.l. 

The program handx.c was written in modular form to peifoim all of 
the functions required for the real-time operation of the DHM, vibrotactile 
displays, and visual displays; the experimentation; and the data recording and 
analysis. The code was developed over several months on an AT&T 6300 PC 
using Microsoft C v4.0, but after much difficulty with the resolution of the vi- 
sual display, and witfi this PC's low speed, the code was rewritten for MSC 
v5.1, and run on a WYSE 286 PC. The final version, hand31,c^ is listed in 
Appendix B.2. 

Rgure 2.4.1 below shows the flow diagram for handSIx, Hie inner 
loop is rimed from die video vertical retrace signal, and thus luhs at 60 Hz, 
for a total trial time of 30 seconds. The outer loop is mn as many times as die 
user requests, each run for a distinct combination of displays. 

At the end of each 30-second run, the recorded data were analyzed to 
produce the required measures of the subject's performance. The procedure 
used is outlined in Section 2.8. The program was designed to be run in eidier 
a practice mode, or in a trial mode in which data were recorded and subse- 
quentiy analyzed (see Figure 2.7.4). 
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Fi gure 2,4,1: Flow D iagram for the Propram handSl.c 
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2.5 ModellinP the IJsi»r'>i Hand: 



A central requiiement for ttie software was that it compute the motion 
of the user's fingers, so that suitable signals could be sent to the displays. A 
non-linear transformation is required in order to get from sensor angles to 
joint angles with high precision. However, in order to keep computation time 
to a minimum, which was a necessity if the PC was to perfonn all the required 
functions and still run at a mininuil 60 Hz, a linear model of the hand was cho- 
sen, and was found to perform adequately. Figures 2.5.1 and 2.5.2 below 
show the phalanges of the right thumb and index finger as they were mod- 
elled. 

A part of handSl.c is the calibration routine, calibrate(), which records 
two specified angles for each relevant joint of the thumb and index finger, and 
two graspmg positions (0 cm apart, and 5 cm apart) for the fingers. The user 
enters the combmed length of the three index fmger phalanges; individual 
phalanx lengths are then scaled from measurements made on the authoi's 
hand. In the main routine, these calibration constants are used to determine 
finger tip positions according to the following linear models. 

2.5.1 The Thumb 

From Equation 2.5.1, below, it can be seen diat the thumb was treated 
as a single element which could be moved in bending at one of the proximal 
joints, and laterally at the other proximal jomt The angle Qi is the amount of 
bending at this proximal joint See Figures 2.5.1 and 2.5.2 for the variables. 

dt' = [Iti + lt2 + lo] . sm [f - G i] . cos [%]. (2.5.1) 
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dt ~ {dt' - x«ropo3 101} X calf actor. (2.5.2) 




View A 



Figure 2.5.1: Joint-Plane Elevation of the Thumb 



fingers 
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0000 ^ > 




thumb 
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Figure 2.5.2: Front Elevation of the Hand 



The angle Bo is the amount of lateral deflection at this joint, and is used to 
detennine die influrace of the angle^ 61. The zero position is then subtracted. 



1 When 80 is 0°, the thumb moves in opposition to the index finger, and the influence of 9l 
on dtis at a maximtim. When &o is 90^, die diumb also moves across the palm, and the 
influence of 61 is at a mimm n n i 
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and the result is multiplied by the scaling constant (obtained during calibra- 
tion) to yield the desired distance, as shown in Equation 2S.2. 

2.5.2 The Index Finger 

The index finger is treated in much the same way as the thumb, except 
that radial and ulnar deviations (lateral movements) play no significant part in 
the grasping motion of interest, and all diree phalangeal joint angles^ are mea- 
sured. Figure 2.5.3 shows an elevation of the index finger, as modelled. 




Figure 2.5.3: Side Elevation of the Index Finger 



The contributions to di of each of the three phalanges are calculated ac- 
cording to Equations 2.5.3, 2.5.4, and 2.5.5. See Figure 2.5.3 for variables. 

<iii = lii . cos [05] (2.5.3) 

^ Strictly, the three joints are (from hand to fingeitip) die metacaipal-phalangeal joint, and the 
proximal and distal intetphalangeal jcnnts. 
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di2 = .li2 . COS [65 + ee] (2.5.4) 
do = li3 . cos [05 + 06 + 67] (2.5.5) 

di= {dii + di2 + di3 - zeropos[l]} X calfactor (2.5.6) 

The zero position is then subtracted, and the result is adjusted with the 
calibration factor to ensure tliat the overall scaling is correct. The two values 
dt and di are calculated by program modules thumbcalc() and indexcalcQ re- 
spectively. 

2.6 The Virtual RnviVnimii^iit 

To simplify the nature of the experimentation outlined m Section 3, a 
crade virtual environment was designed. It consisted of two walls, which 
might be considered to be the two parallel surfaces of a virtual plate. In pre- 
liminary versions of handxx, the distance between these walls was held con- 
stant at about 4 cm. However, for the experiments, haiuULc was modified to 
include Equation 2.6.1 to change the thickness of the plate every n cycles (n 
was defined in inputAnp such diat the thidmess was changed at 1.0 or 0.5 Hz). 

w = 30.0 + float{rand() % 50}i (2,6.1) 

Calculated in this way, the plate diickness varied randomly betv^een 30 
mm and 80 mm, with a unifomi Probability Density Function (PDF). Figure 



In C, the operator % yic\A& the remainder when the preceding argument is divided by die 
following argomenL The/bxttcpeiator is lequired to cast, or ocmveit. the integer pro^ 
of the % oper&tion. 
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2.6.1 below shows a typical trace of thickness versus time. Clearly the aver- 
age plate thickness was 55 mm. Even though the frequency at which the 
thickness was changed was constant during a trial, the random amplitude re- 
suited in a signal with diverse frequency content The reader may verify this 
fact by taking flie Fourier transform of flie signal in Rgure 2.6.1. 
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Figure 2,6.1: A Tvpical Trace of Thickness versus Time 
2.7 The Visual and Tactile Displays 

Following the Taxonomy outlined in Section 13, several display pro- 
files were designed for the visual and tactile displays. 

The first display profiles were designed to be realistic in nature. They 
were considered to be displays which might have been developed and used for 
teleoperation tasks. 
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Figure 2,7,1: The Pursuit Full-Range. Linear Visual Display 

Figure 2JA shows the first of the visual displays^ Vsp, which was de- 
signed to provide as much infonnation of a non-predictive nature as possible 
to the user. The first tactile diisplays, T2C and Tic, were non-linear half range, 
and on-off respectively. See Fig. 1.3.2 for details of the display profiles. 

For subsequent e^q)eriments, lower quality visual displays profiles were 
required. These low quality display profiles, V2C and Vic (non-linear half 
range, and on-off respectively), were designed to mimic die tactile displays in 
information content, in order to allow a closer comparison of feedback 
modalities. They arc veiy contrived profiles, designed specifically for the re- 
search outlined in this thesis, and should not be consideied representative of 
profiles which might be used in real teleoperation. The hope was that they 
might simulate nomial visual displays which had been degraded in some way, 
or on-off visual displays which might be used in the presentation of contact in- 
formation during fine teleoperation. These two low-quality displays are 

1 Note that for all the visual displays, the only characters drawn to the screen were the two 
finger icons, and the t^o plate boundaries. Othct lines shown are for dimensions & labels. 
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shown in Figures 2.7.2 (a) and (b). Sec Figures 13.2 (b) and (c). respec- 
tively, for the error-stimulus characteristics of these displays. In the half- 
range non-linear display of Figure 2.7.2 (a), the fingertip icons were not vis- 
ible when the fmgertips were outside the virtual plate. When the fingertips 
touched the plate, the icons appeared, and as the fingertips penetrated the 
plate, the icons moved inside the walls until diey reached the saturation points, 
beyond which movement of the fingertips resulted in no change in the visual 
display. During flie trial, the walls were shown in the same location, so that 
the visual display was compensatory. In the on-off visual display shown in 
Figure 2.7.2 (b) the wall icons were again held in fixed locations. The fin- 
gertip icons were shown inside the walls when the fingertips were inside or 
were touching die virtual plate, and were not show otherwise. This visual 
display is analogous to the on-off tactile display. 




(a) (b) 
Figure 2.7.2: The Low-infor mation Visual Displavs (Voc & V ic^ 



Finally, two more designs for tactile display profiles were suggested, hi 
one*, as the subject's finger tip touched an object, he was given a vibration 
'spike* to demarcate the object's boundary, see Figure 2.7.3 (a). The signal 

1 Suggested by Prof. R Alocander, of MIT. 
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was then reduced, leaving die whole of die display transducei's range available 
for providing cues about penetration. In the other design, proximity* was 
coded, see Figure 2.7.3 (b). These last two displays were not tested in detail 




(a) (b) 
"spike" coding proximity eodlng 



Figure 2.7.3: The Characte ristics of Two Other Tactile Displav Profiles 
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Figure 2.7.4: The Menu of Display Choices 



1 Ptoximity is easy to implement for YE interacuon, and is possible for R£ interaction given 
extra sensors. 



43 



At the begiiming of each experimental trial, the user was prompted to 
choose between die display options. His choice was detemiined by the ex- 
periment design outlined tn Section 3.1. Bgore 2.7.4, below, shows the menu 
of display combinations available to the user. An 'x* is used to denote no dis- 
play. 

2.8 Design of Data Analysis Software 

Following the method of Hirsch & Kadushin [1964], who studied die 
control of aircraft using vibrotactile cues to the pilot, it was decided to use a 
magnitude-of-error measure of performance rather than an error-squared 
measure, since the latter would have given too much weight to the error 
during initial response to the random change in plate thickness. It was felt that 
over-emphasized initial-response errors would obscure the equally important, 
but smaller, errors measured between plate changes. Tlie error for both 
^gers, eb, was calculated in die analyze() program module of hand31.c using 
Equations 2.8.1, 2.8.2, and 2.8.3: 




(2.8.1) 




(2.8,2) 



eb = et + ei. 



(2,8.3) 
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After some experimoitation, it was determined Ihat normalized error, 
en, was a better measure of performance tiian eb, so the analyze() module was 
rewritten to include Equations 2.8.4 and 2.8.5. See Section 3.4 for details. 

mp = MAXoouNF • Z abs[wj-Wj.i]. (2.8.4) 

Equation 2.8.4 provides a measure, mp, of the difficulty of the random task of 
following the change in ^daiess of the virtual plate. 

e„ = ^. (2.8.5) 

The error, eb, is then normalized with this measure, according to Equation 
2.8.5. 
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3 Experimentation 



3.1 Experimental Sgtup 

Each subject was seated directly in front of the PC, and the DHM was 
fitted to the subject's right hand (all of the subjects were right-handed) as 
shown in Figure 3.1.1. Each subject was given a detailed explanation of the 
nature of all of the visual and tactile displays, and was then taken through trial 
runs with each type, at his^ own pace, until his performance scores stabilized. 



r'ght hand. DHM 
& virtual plate 




Figure 3. LI: A Plan View of the Experimental Setup 



For the recorded trials, subjects were instructed to minimize the dis- 
tance (in either direction) between the index finger and its side of the target 
plate, and between the thumb and its side of the target plate, simultaneously. 



1 Because female subjects are relatively scarce at Mir, only male subjects were used in these 
experiments. 
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Subjects were also instructed to look directly at the screen, whether or 
not diere was a visual display. 

The subject's motivation proved to have a large influence on his per- 
formance. Maintaining diat motivation became one of the authoi^s primary 
concems during testing. 

Widi some subjects, the tactile display element produced a faint buzz 
when activated. Where necessary, tiiis extra auditory feedback was masked 
with static fironi an FM radio widi headphones^. 

Since some of the display profiles were more intuitive to use than 
others, it was felt that there would be asymmetric transfer of leaming^ be- 
tween display combinations. This would have invalidated a balanced experi- 
mental design. Therefore, in all display comparisons, trials with different 
display combinations were organized randonily in groups. For instance, in a 
set of 25 trials, S each with 5 different display combinations, the subject would 
perform one trial with each combination (in random order), then a second 
trial with each combination (in a new random order), and so on. Anodier 
benefit of this random design was that large numbers of trials could be 
organized without the difficulty of balancing their orders. 

.2 Early Qualitative Observations 

Qualitative infomiation was obtained from the subjects during initial 
testing, and throughout the experiments. 

1 Masking might have been achieved more effectively by activating extra tactile transducers 
near the subjects* ears to mask the sound fiom those at his fingertips* 

2 Asymmetric transfer occurs when the effects of training in one task on the performance of a 
second are imequal to the effects of training in ibe second task on the performance of the 
first i.e. leaniing from a to bis not the same as that from b to a. Under ^ese conditions a 
balanced e9q)eriment would be biased. 
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The subjects did not have trouble understanding the design of any of die 
display profiles, although their results serve as a better testament to that fact 
than these words. Most of the subjects reported that both of the tactile profiles 
(T2C and Tic) were "realistic" and easy to use. All questioned felt that the 
low-information visual profiles were unrealistic (as they were intended to be), 
and that they were hard to master. Several of the subjects perceived the vir- 
tual plate as a vibrating plate. This was not in accordance with the author's 
expectation, which was that the vibrotactile display would give the feeling of 
contact with a stiU, solid object. 

The tactile 'spike' coding (see Figure 2.7.3), although hard to unple- 
ment in a system with only a 60 Hz sampling rate (fast movement would allow 
die ftiger to pass through die spike zone between samples), was understood by 
all of the subjects who used it. One of these subjects felt that the extra 
dynamic range left for die coding of penetration was useful 

Finally, some subjects had difficulty in detecting lower levels of vibra- 
tion, and in detecting changes in the amplitude of vibration. 

3.3 Preliminary Comparison of the Displays 

The purposes of die first set of experiments were: (1) to make a prelim- 
inary estimate of die qualities of die various display combinations; and (2) to 
establish guidelines for subsequent experimentation. 

These first experiments were performed with 5 subjects. Each subject 
performed trials with each of the 5 combinations of displays 5 times, produc- 
ing 25 trials of each combination. The combinations of feedback which die 
subjects used were: V3P+T2C, V3p+Tic, V3p, T2c, and Tic. The means ( x ), 

standard deviations (s), and standard errors of the means ( a/'/n ) of the 
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tracking errors are shown in Appendix C, Table C.l. The mean errors are 
shown with 90% confidence intervals in Figure 3.3.1 below. 
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Figure 3.3, 1: Results of Preliminarv Experiments 



The 90% confidence limits for the population mean were determined 
using Equation 3.3.1, with Za = 1.645. 

X - z«-:^ < < X + za,;^ (3.3.1) 

Apparently, use of the half-range, non-linear, tactile and visual displays 
together produced an improvement in performance of about 10% over use of 
the visual display alone. This difference seems small, but the reader must re- 
member that the information the subject required to perfoim the task was 
provided in the visual display, leaving little room for improvement 
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Since the standard errors for these results were relatively laige com- 
pared with ttieir separations (Figure 3.3.1X it was necessary to use a statistical 
test to determine how significant the observed differences weie^ One appli- 
cation of the Student t-test would have involved pooling the data for each case, 
and ccHnparing pooled means using a common estimate of die population's 
standard deviation. However, several factors conspired to render such a t-test 
maccurate. First, the subjects demonstrated varying levels of ability. This 
contributed to the large variations in the observed results. Second, because of 
training, fatigue, apathy, and possibly other factors, each subject's perfor- 
mance varied to some extent Aroug^out his session, pardally invalidating any 
comparison of performance between feedback cases. The solution to these two 
problems was to employ a t-test for paired observations, in which the perfor- 
mance for one trial was subtracted from the peifonnance from another with 
which it was to be compaxed. Thus, the second V3P+T2C run for the diird 
subject could be compared more direicdy wifli his second V3p run. The result- 
ing value of the t statistic for the comparison of the means of any two sets of 
data could be used directly, as a measure of the probability of random pro- 
cesses alone yielding observed difference. Alternatively, the process could 
be reversed: one could set 90% confidence limits, and detennine what differ- 
ence between the means the data would support at this level of confidence. 

d - tan.^ < jid < "d + toAi.^ (3.3.2) 

This latter metiiod was periiaps tiie more illuminating. Equation 3.3.2 
was used to calculate confidence linuts for the population mean difference, pd> 

1 The Student t-test was used instead of ANOVA since the author wanted to determine the 
sizes of the differences in means, nctt just the significances of the differences. 



using the sample mean difference, d , and its standard deviation, sd. The re- 
sults of the paired t-tests are summarized below in Table 3.3.1. Columns (m) 
and (IV) ^ow the estimated reduction in mean enor from display combination 
(a) to display combination (b) with 90% confidence limits, expressed as per- 
centages of the larger mean. Columns (V) and (VI) show the t-values for 
pairwise comparisons^ and die probaibilities of achieving these values by 
chanc». 
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V3+T2 


V34^T1 


-1.5% 


±5.9% 


-0.43 


335% 


V3+T2 


V3 


-9.1% 


±5.4% 


-2.91 


0,4% 


V3+T2 


T2 


-29.8 % 


±6.5% 


-7.81 


< 0.01 % 


V3+T2 


T1 


-43.5% 


±12.1 % 


-6.13 


< 0.01 % 


V3+T1 


V3 


-7.8% 


±5.2% 


-2.58 


0.8% 


V3+T1 


T2 


-28.7% 


±6.2% 


-7.90 


< 0.01 % 


V3+T1 


Ti 


-42.6% 


±115% 


-6.33 


<0j01% 


V3 


T2 


-22.7% 


±5.4% 


-7.19 


<0.01% 


V3 


TI 


-37.8 % 


±10.4 % 


-6.21 


< 0.01 % 


T2 


TI 


-19.5% 


±9.3% 


-3.58 


0.07% 



Table 3.3.1: Paired t-test Results from the Preliminary Experiments 



These paired t-test results paint a more informative picture of the dif- 
ferences between the displays^. We can see that the addition of the tactile dis- 
plays, T2 and Ti, to the visual display, V3, improved performance by 9% and 
8% respectively. Bodi differences are significant beyond the 99% confidaice 
level. As may be expected in a task where the displays were redundant, there 



1 Detennined using StatView n on an Apple Macintosh. 

2 Note that combination (a) was better dtancombinadon(b)meveiy a This is not 
coincidental, the table was arranged to reflect the author's expectation that performance 
would improve with Ac display's inf carnation content 
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was little difference between peifoimances with V3+T2 and V3+T1 display 
combinatidns. However, where die tactile displays did not provide redundant 
information, i.e. where they were used alone, tiiere was a significant (beyond 
the 99% confidence level) difference of about 20% between peifonnances 
witii T2 and Ti displays. 

3.4 Normalization of the Performance Data 

During the analysis of the results from the preliminary comparison of die 
displays, it became evidoit tiiat the random nature of die task had resulted in a 
difficulty level that was Varying substantially from trial to trial. This varia- 
tion in task difficulty was thought to be partially responsible for the relatively 
large observed standard deviations. To reduce this effect, a measure of task' 
difficulty, was required witii which die observed performance variable, mean 
error (eb)« could be normalized. Two obvious candidates were: (1) a quantity 
proportional to die mean magnitude of the difference between instantaneous 
virtual plate thickness and average virtual plate tiiickness: 



and (2) a quantity proportional to the average rate of change of the plate 
diickness: 




(3.4.1) 



60 



X abs[wrWi-i]. 



(3.4.2) 



- MAXOOUNT • 
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In order to asses the merits of normalization with these two variables, 
the author performed 25 trials with both full visual and full tactile feedback 
(i.e. V3P+T2C) after which the above quantities were calculated. Hie results 
are shown in Table 3.4,1. The raw data is listed in Appendix C, Table C.2. 



Measure 


ebCnvn) 


eb(mm) 


nip (mm) 


eb/Op 


Ob/mo 


|t 
a 


7.401 
0.903 
12.2% 


12.412 

I. 447 

II. 7% 


16.121 
2.199 
13.6% 


0.599 
0.061 
10.3% 


0.461 
0.028 
6.1% 



Table 3.4.1: Results of the Noim alizadon Experiments 

From Table 3.4.1, g/\l for the two measures of task difficulty, Cp and mp, at 
about 12% and 14% respectively, shows large variations within the group of 
25 30-secQnd trials. However, when the performance measure eb was divided 
by each of the task-difficulty measures in turn to yield eb/cp and eb/mp, eb/mp 
emerged as the superior measure, since it halved the relative size of the stan- 
dard deviation of the results to about 6%. Following tiiis result, the program 
hands Ix was modified to provide the parameter eb/mp, henceforth referred to 
as en, for all trials. 

3.5 Setting an Upper Bound on the Normalized Error 

No analysis of the results of these experiments could be understood 
completely without a benchmark against which to measure the levels of per- 
formance achieved using tfiese kinds of feedback. To put the subjects' per- 
formances in perspective by providing an upper bound for normalized error 
(a lower bound for perfoimance), three sets of trials were performed in 
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which the subject (die author) did not respond to any visual or tactile stimuli^, 
and did not attempt to minimize error. The results of these trials are listed in 
Table C.3, Appendix Q and arc summarized below in Table 3.5.1. 



In the first trials, die fingers were held as far as possible apart for the 
duration. In the second, the fingertips were held together throughout. The 
errors in both cases seemed uniealistically large when compared with a typical 
performance where en was near 1. In die third case the fingers were moved 
apait and together as quickly as possible (so as not to be 'in st^' widi tlie 
plate's movement) for the duration of the trial. The resulting normalized 
error of 4.1 might be representative of die peifoimance of a subject who was 
unable to understand the tactile or visual cues, and was responding to diem in 
a random manner. It was taken as a reasonable upper bound for error. 

3.6 Performance Comparison: Two Finyers vs. One Finger 

Tlie chosen measure of performance, Cn, was based on eb, the sum of 
the mean errors for the thumb and the index finger. The subjects were in- 
structed to attend to both fingers equally while tracking die virtual plate. 
However, they were not constrained in any way to minimize the errors for 

1 llie author used the null visual display (Vq) and tamed off die analog electronics. 



Strategy 



Rogers Apart 
Rngers Together 
Rngsis Oscillating 



7.9 
8.8 
4.1 



Table 3.5.1 : Upper Bounds on N ormalized Error 



55 



both fingers equally: the task involved 2 degrees of freedom. The subjects 
could not have been expected to perform as well in such a 2 d.o.f. task as in a 
1 d.o.f. task. For example, one group [Massimino, Sheridan, & Roseborougih 
1989] found that, in pursuit tracking tasks with visual feedback, r.m.s. track- 
ing error increased with the number of degrees being tracked, particularly 
with 1 to 3 d.o.f, Hierefore, it was reasonable to ask whether or not it was 
correct to measure ^e error from both fingers. 

Assuming that the primary puipose of the experimentation was to 
demonstrate the use of the tactile displays for dextrous interaction, where tasks 
are typically performed with many fingers, the answer was that Cb was a rea- 
sonable measure. However, had this research been aimed at providing a more 
basic understanding of the role of touch in manual operations, then eb would 
not have been as reasonable a measure. 

To examine ^le effects of coiicoibating On both fingers, versus concen- 
trating on only one finger, and to determine whether or not one finger was 
given preference during the terrain-following task, a set of three experiments 
was performed by the author. Six trials were run with the author minimizing 
the error at: both fingers, just the thumb, and just the mdex finger. The re- 
sults are listed in Appendix C, Table C.4, and are summarized below in Table 
3.6.1. 



en (a) 



en(b) 



% change in 
mean error 



P 

(l-tail) 



(Uartib) 



Th, together 
IF, together 



Th, alorte 
IF, alone 



10.8 % 
3.0% 



4.73 
1.44 



2.6% 
10.4% 



Th, together 
Th, alone 



IF, together 
IF. atone 



4.4% 
-3.0% 



3.47 
-1.31 



0.9% 
12.3 % 



Table 3.6.1: Results of the Paired t-tesstt 
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The errors were ranked from smallest to largest: Uiumb alone, index 
finger alone, index finger togedier, and tfimnb togeflier. Altfiough the diumb 
error was 3% smaller than diat for die index finger when each was used sepa- 
rately^ it was over 4% larger when they were used together. Clearly the in- 
dex finger was getting more attention when the two were being used togedien 

A study in which these errors were measured with only visual feedback, 
and then with only tactile feedback, would likely show that both fingers are 
easier to manage simultaneously with tactile feedback than with visual feed^ 
back (other factors being equal) since tactile feedbadc provides cues which are 
localized at the fingers which must be moved, and the response, once learned, 
may rely on faster spinal sensory-motor loops than the response to visual cues. 
Such a study would require tactile and visual displays which were well 
matched for information content and ease of understanding. As will be shown 
later in this section, none of the displays developed here were well enough 
matched for such an experiment. 

So what? These few experiments examining the performance differ- 
ences between two fingers and one finger have raised some interesting ques- 
tions, but have answered none. I have added them here to give tiie reader a 
taste of the depth to which such research may extend. 

3.7 Pcrformange Comparison with the Full Displays 

For the first major comparison of displays, those combinations of feed- 
back which were considered useful, i.e. most representative of those tiiat 



1 The author has no satisfactory explanation for this fact It is perhaps due to the thumb's 
sooaUer i^ge of motion, or because tfie thumb has fewer joints which are used in the ap- 
ptopriale grasping motioiL 
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would be developed for an application like space teleopefation, were used. Six 
subjects performed a total of 201 trials between the three display 
combinatioas. The means are plotted in Figure 3.7.1, below, along with 90% 
confidence limits, calculated using Eq. 3.3.1. 
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Figure 3.7.1: Results of the Rill-Displav Trials 



Note that the normalized errors shown in Figure 3.7.1 were all well 
below the estimated upper limit of 4.1, as expected. This supports the fairly 
trivial assertion that the combination of visual and tactile feedback might be 
useful in teleoperation. 

The results were analyzed with the pairwise t-test used in Section 3.3. 
Table 3.7.1 shows the differences in means with confidence limits, and the t- 
test results. All of die differences shown are significam beyond the 99% level. 
More importantly, the differences in means show that tiht visual display pro- 
duces an error about 2/3 that of the tactile display. 
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The peiformance with the combined display (V3+T2) was mudi better 
than that with the tactile display (T2). This was expected, since the fonner 
contained the pursuit visual display which presented the most information to 
the subject As before, the combined display (V34-T2) was only 3% better than 
the visual display (V3), since the infomiation added by die tactile display was 
redundant. 
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tji-u 


P 
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V3 + T2 


V3 


-3.1 % 


±1.7 % 


•3.06 


<0.15% 


V3 + T2 


T2 


-34.5 % 


±4.2 % 


-13.58 


<0.01% 


V3 


T2 


-32.7 % 


±4.3 % 


-12.78 


<0.01% 



Table 3.7.1: Paired t-test Results from the FuU-Displav Trials 

This experiment shows, quite clearly, that there is little to be gained by 
adding a tactile display to an adequate visual display. However, where die vi- 
sual display is inadequate (either because the visual channel is noisy or is 
otherwise limited in capability) this inight not be the case. 

Bliss [1967] made a simUar compaiison between visual feedback, tactile 
feedback (using a compensatoiy tactile display mounted on the palmar side of 
the subject's hand), and bodi, for a 1 d.o,f. tracking task. The mean r jn.s. er- 
rors he obtained arc sunimarized in Table 3.7.2 next to the nonnalized mean 
errors obtained during this research. The two sets of results have been di- 
vided, one by the other, and then iionnalized with respect to the V+T display 
ratio to facilitate comparison. 

Note the close agreement between the two sets of results for the vi- 
suaUtactile and visual feedback conditions. Again, die tactile display added 
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little to an already adequate visual-only display. Hie rather poorer agreement 
between the results for the tactile-only feedback condition is hard to explain, 
but may be because Bliss provided tactile feedback to the hand, while the re- 
sponse he measured may have been lateral rotation of the subject's headi. By 
comparison, in the author's experiments, the tactile stimulus was provided at 
the fingertips, nearer to the motor elements controlling the response. 





Both (v+T) 


Visual Only (v) 


Tactile Only (t) 


Bliss [1967] 


2.11 


2.33 


5.49 


Patrick 


0.5174 


0.5339 


0.8004 


Ratio 


4.08 


4.36 


6.86 


Normalized 


1.00 


1.07 


1.68 


Ratio 







Table 3.7.2: Comparison of Results. Bliss vs. Patrick 



3.8 Performance Comparison with th e Low.Tnformation Displays 

In order to determine the value of a tactile display in a situation where 
the visual display is degraded or altogether absent, and in order to acquire 
some qualitative understanding of the differences in performance with visual 
and tactile feedback (other than those due to information content and com- 
plexity of the displays), a pair of low-information visual display profiles was 
designed. These two display profiles, V2 and Vi, were designed to be analo- 
gous to the compensatory, non-linear tactile display profiles widi which they 
would be compared. The design of these profiles is summarized, somewhat 
out of order, in Section 2.7. 

1 This is the author's supposition. Bliss does not mention the OTigin of the output variable he 
measured. 
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For the trials wilfa these low-mfoimatioii display profiles, die file in^ 
put.inp (which contained die plate-diickness refresh period, in 60di's of a sec- 
ond, see Appendix B2) was changed so that the plate thickness was updated at 
f^QJS Hz^ instead of die /= 1.0 Hz used in die full-display trials, since it was 
felt that the higher rate would have heen too challenging widi these displays. 

Four subjects completed 120 trials between them. Trials were added to 
the pool until the average half-width of the 90% confidence interval for the 
differences in means was reduced to less than 30% (aifoitrarily chosen) of the 
average of the differences in means for the comparisons. This process, 
although somewhat unorthodox, was essoatiaUy the same as choosing the sizes 
of the samples so as to produce die required resolution of the sample means, 
except diat it could be done widiout prior knowledge of any of the sample's 

« 

statistics. 

After the data had been collected, the largest result for eadi display 
combination was discarded as an outlier. Fortunately all of these oudiers were 
produced by a single subject, so that their deletion did not complicate the 
pairwise comparison, it was reasonable to remove the largest outliers without 
removing the smallest^ since the distribution of errors was non-symmetrical 
(all errors were positive) and an error of zero was unattainable. In other 
words, very bad results were easy to achieve and were hkely to be the result 
of inattention or misunderstanding, while very good results were harder to 
achieve and did not result from these disqualifying causes. 

As with the full display profiles, all nomialized errors were well below 
the estunated upper bound of about 4.1. This statement is more significant 
here than it was in the last section: before the data were analyzed diere was 
some concern diat the task would be too difficult with only die low-informa- 
tion visual displays. However, diis was clearly not the case. The means, widi 
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90% confidence limits on population mean, calculated using Eq, 3.3.1, are 
shown in Figure 3.8.1. 
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Figure 3.8.1: Results of the Low-Information Display Trials 



The reader may note the reassuring agreement between the T2 error of 0.83 
obtained during the low-infoimation display trials (Figure 3.8.1), and the T2 
error of 0.80 obtdned during the fiifl-display trials (Figure 3.7.1). Although 
the full-display trials used an environment update rate, /, of 1.0 Hz, and those 
with the low-information displays used / = 0,5 Hz, the close agreement be- 
tween errors is possible because each error was normalized with mp, which 
was a measure of the task difHculty, specifically the rate of change of the plate 
thidkness. 

Table 3.8.1, below, summarizes the results of the paired t-test compar- 
isons of display combinations. The better tactile display (T2) is seen to have 
produced performances which were 16% better than those produced with the 
better visual display (V2). Similarly the lesser tactile display (Ti) produced 
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peifoimances which were 29% better dian those produced widi ttte lesser vi- 
sual display (Vi). 



Display Combinafion 


Difference 


90% 


w 


P 


(a) (b) 


in means 


confidence 


(1-laII) 






firits 




V2 T2 


16.1% 


i5.1% 


5.156 


< 0.01% 


V2 VI 


-22.5% 


±5.9% 


-6.292 


< 0.01% 


V2 tl 


0.2% 


±5.5% 


0.055 


48% 


T2 VI 


-33.3% 


±5.7% 


-9.635 


< 0.01% 


T2 Tl 


-13.7% 


±3.9% 


-5.714 


< 0.01% 


VI Tl 


29.3% 


±7.9% 


6.091 


< 0.01% 



C.I7diff.« 29.6% 

Table 3.8.1: Paired t-test Results: Low-Information Display Trials 



Of the six comparisons from Table 3.8.1, the most striking is that be- 
tween V2, tiie better visual display, and Ti, the lesser tactile display. The dif- 
ference ill performance was statistically insignificam. This comparison sum- 
marizes flie findings of these experim^ts: that the tactile displays were supe- 
rior to the degraded visual displays. 

^-9 Performance Comparison: Reactive & Non-reactive Displays 

Related research by Michael Massimino, of the Man-Machine System 
Laboratory (MMSL), provides some of the most compelling support for the 
adoption of tactile displays for teleoperation and VE interaction. Massimino 
compared operator performance (actually tapping period) in a Btts' Tipping 
Task using the following combinations of feedback: Reactive and visual feed- 
back (R-i-V), tactile and visual feedback (T+V), and visual feedback alone (V). 
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These experiments were conducted using the MMSL's master-slave manipula- 
tor, the author's vibrotactile feedback apparatus, and a closed-circuit TV cam- 
era and monitor. Figure 3.9.1 below shows the times required per tap for 
each of the feedback combinations, as functions of the index of task diffi- 
culty!. Id- 
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Figure 3.9.1: Results of Prelimin ary Experimentation bv Massimino 



It is clear that almost all of the benefit obtained by adding force feed- 
back to the visual feedback, particularly for die less difficult tasks, may be 
obtained with the much lighter and less expensive tactile feedbadc apparatus. 

As with previous comparisons, it proved instructive to place confidence 
limits on the percmtage improvements in peifonnance. Since sample sizes of 
40 were used in this experiment, the distribution of results could be approxi- 



1 The index of difficult, I<|, was equal to the quotient of die target dze and die taiget separa- 
don, expressed in tnts. 
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mated by a nonnal distribution. Thus, confidence limits were determined ac- 
cording to Eq. 3.9.1: 

(Ti-Ta) - za/i < W < (7i-72) + z,vaA/if^m • ^^'^'^^ 

Means, with 90% confidence limits, for the differences in treatments 
derived in diis way are presented below in Hgure 3.9.2 for the three indices 
of difficulty. Id = 3, 4, and S. Hie data from which diis graph was con- 
structed arc presented in table C.7.b, in Appendix C. 
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Figure 3.9.2: Percentage Change in Performance Between Displays 



Figure 3.9.3 below shows a graph of information rates obtained with 
each of the display combinations, for each value of Id* In ibis context, infor- 
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mation rate is a measure of perfonnance, since it is proportional to tapping 
frequency. Again, it can be seen that most of the performance improvement 
obtained v/ith FW feedback was obtained widi T-»-V feedback. It is interesting 
to note that the information rate (and thus the peiformance) was not at a 
maximum for the most difficult task, but rather for the intermediate task. 




T+V 
F^dbackMode 



Fipire 3.9.3: Information Ra te Comparison 

Other research has demonstrated the value of tactile feedback in addi- 
tion to reactive force feedback. Bliss et al, [1971] combined a 48-element vi- 
brotactile array (which provided the user with contact area information) with 
reactive force feedback from a Rancho 7-d.o.f. arm. They found that the add- 





Condition of Kupu Latdi 


Tactile FB 
Condition 


Visible 


Partially 
Obscuied 


Qraopletdy 
Obscured 


On 


100% 


95% 


80% 


Oflf 


83% 


75% 


40% 



Table 3.9.1 : Results of Experiments by Bliss et al. 
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ition of the tactile feedback substantially improved the completioii rate for 
their experimental task, the remote retrieval of a Kupu latch, especially when 
the latch was partially or completely obscured. Table 3.9.1 shows task com- 
pletion rate (in perc^t) for different latch conditions, botfi with and without 
tactile feedback. 

3.10 task Load Index a Measure of Performance 

The author was interested in testing die relationship between subjective 
workload index and measured performance. It was hoped diat a subjective 
assessment of workload might be used in place of objective performance 
measures, like en, in a comparison of different display combinations where 
performance might be difficult to obtain. 

Since high workload is detrimental to task performance, it was expected 
diat mean error might be a monotouic, increasing function of woridoad. 
NASA Ames' Task Load Index (TLX) multidimensional workload rating 
method [NASA, -] was used ffrst to detemiine die relative importance of the 
different components of workload (weights), tiien to determine the magnitude 
of each of the contributors to workload (ratings). The six components, or 
weights, were Mental Demand, Physical Demand, Temporal E)emand, Sub- 
jective Performance^ Effort, and Frustration. The weights, ratings and per- 
formance data^ are listed in Table C.8, in Appendix C. 



1 The subject estunated his own perfonnance widiout lefming to the measured value of en. 

2 Where data firom low-informadoii display trials is used, it ha'i been adjusted by a scale fac- 
tor of 0.750A).605 to account for the fact that it was obtained with f=0^ Hz, instead of 
/=1.0Hz. Sec Table C8. 
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Figure 3.10.1 shows normalized error, en, against task load index, for 
most of the display combinations. Note the reasonable correlation coefficient 
of about 0.81, and the [0,0] intercept 




0.0 0.1 0.2 0.3 0.4 O.S 0.6 0.7 0.8 0.9 1.0 



Task Load indax 

Figure 3.10.1: Normalized Error vs. Task Load Index 

The values of error were taken from the full and low-information dis- 
play trials, while the workload ratings were obtained in a third, dedicated set 
of trials. For this reason, ihe correlation between TLX and ea was not as good 
as it might have been. Wifli improvement, however, TLX might indeed be 
substituted for measured error in display comparisons where measurements 
are hard to take. 
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4 Conclusions 



The main purposes of this reseairch: to desi^ an inexpCTsive, light, and 
small tactile feedback device, and to demonstrate die utility of the tactile feed- 
back during dextrous interaction with a virtual environment, have clearly been 
adiieved. 

Designs for bodi reactive and non-reactive feedback devices have been 
considered, and reactive devices have been shown to be far more e;q)ensive 
than their non-reactive counteiparts. Of the many alternatives designs for 
tactile displays discussed, the vibrotactile display has hcea chosen for its sim- 
plicity, low cost, light weight, and low volume, and ease of implementation 
with a high degree-of-fieedom precision joint measurement device. The de- 
tailed design of an analog electronics unit capable of driving diis kind of dis- 
play has been completed, as has the design of software to calculate fingertip 
positions, to provide visual displays, and to run the tactile displays. 

Tactile feedback has been shown to provide a small but significant im- 
provement in operator performance when used to siq;)plement Visual feedbadc 
Tactile feedback has also been shown to be superior to visual feedback in cases 
where tiie information content of tiie visual display is limited to that of the 
tactile display. These two points alone argue strongly for the inclusion of de- 
vices for tactile feedback for systems requiring human interaction with VE's 
and re's. 

Research has been cited which ^ows that non-reactive tactile feedback 
confers to an operator many of the advantages of reactive force feedback. It 
may be used in place of reactive feedbadc with littie reduction in task perfor- 
mance, or it may be used to supplement reactive feedback, where it proves 
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particularly useful during complex tasks where visual feedback is degraded or 
absent Tactile feedback may also prove useful in teleopeiation wheie a large 
transmission delay is present. Since there is no direct interaction between the 
display element and the input element with tactile feedback, it will not 
contribute to instability in the way reactive feedback does. 

It has been shown that a subjective measure of task woik-load (in this 
case NASA's TLX) can be used in place of a more objective measure of task 
perfonnance with some confidence. This may prove important in evaluating 
displays used in situations where measurement is impractical or impossible* 
For instance, in a space teleoperation task conducted without supervision and 
without measurement of perfomiance, the use of subjective task load index 
may still allow several display types to be compared wiUi some accuracy. 

There arc many more experiments which could have been performed, 
and areas which could have been investigated using this apparatus or improved 
versions. Some of these are mentioned in the Section S, Recommendations, 
which follows. 
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5 Recommendations 



for further development and experimentation 

There axe moie areas in which to expand both the design and the exper- 
imental sides of this research than I can enumerate. Here are just a few. 

It should be possible to build a five-fingertip, 3-space, vibrotactile 
display and demonstrate 3-D dextrous exploration, and perform more 
complex and realistic tasks with tactile feedback. The model of the human 
hand in handSl.c woiked admirably on the author's hand, with which it was 
developed, and well on other hand^ of the same size. However, it's 
performance was inconsistent on much smaller or larger hands. It might be 
improved to allow consistent, trouble-free use by all subjects, and would 
certainly need to be changed for 3-D interaction. 

A more detailed comparison of task performance with non-reactive and 
reacdve displays might be att^pted. It would be easier without the added 
con^lexity of demonstrating dextrous interaction. 

A set of experiments might examine the expected superiority [Ferrell, 
1966] of non-reactive displays during teleoperation with transmission delay, 
where reactive displays can generate instability. An investigation of the bra- 
efits of tactile feedback to die active hand over reactive feedback to the inac- 
tive hand would be particularly interesting. 

Another study might investigate the perfomumce differences between 
one- and multiple-fmgered interaction widi only visual feedback, and one- and 
multiple-fingered interaction widi only tactile feedback. Such an investigation 
might shed some light on the importance of the fact that latency of response to 
multiple stimuli (interaction with multiple fingers) can be reduced by provid- 
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ing tactile cues at the fingertips, rather than relying on the higher-level 
processes associated with visual assimilation of infoinnation. 

A better understanding of die greater speed and sensitivity of cutaneous 
sensation than proprioception during touch and manipulation, as explained in 
Section 1.2.3, is important to the design of future tactile feedback systems. 

Different tactile display profiles or coding schemes may be developed 
and tested. When used in conjunction with a virtual environment, or with a 
remote environment and proximity sensors, the coding scheme shown in 
Hgure 2.7.3 (b) might be tailored to provide the operator with a sense of 
proximity to an object. Other designs might help him gauge an object's 
physical properties. For mstance, the display signal might be pulsed at a 
frequency dependant on the touched object's t^perature or weigjit 

Investigation is required to determine the significance of sensory adap- 
tation (due to continuuig exposure to vibration) and of sensory fatigue (due to 
previous vibration) to in the RA mechanoreceptors. Bodi of these effects are 
known to occur with hearing^; and the auAor, having noticed fatigue after 
prolonged use of th& vibrotactile displays, feels that adaptation may also be 
important for touch. In addition, the subject's age seemed to be related to his 
ability to discriminate and detect levels of vibration. The extent of 
deterioration of this sense with age (if there is any) should be determined, 
since any future design should consider die requirements of users of all ages. 

It would be useful to be able to measure the realism and capability of a 
display or suite of displays, since the more realistic a display is, the easier it 
should be to learn to use; and die more capable it is, the more useful it will 
prove to die experienced user. A simple "Chinese Room" test, of the kind 



1 See Bariow and MoUon [1988], pp 323-324. 
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used in die study of AI systems, does not seon appropriate, since uniealistic 
but informative displays (e.g. predictor displays), which cannot pass sudi a 
"look-and-feef test, are so useful. A multi-dimensional rating scale widi 
which to combine subjective and objective measures of the display*s realism 
and capability might be better. There is much in the literature on the subjec- 
tive rating of vdiicle handling qualities (e.g. die Coc^r-Haiper rating scale 
for aircraft handling qualities), perhaps displays should be subjected to the 
same scrutiny. Such a rating system might include the following measures: 

1) The ratio of rate of information provided by die display. Id, to rate of 
inforaiation expected from interaction with a similar, real environment, 
Ir. This might be of the form shown in Equations 5.1 or 5.2: 



with a separate ratio for each element of the display: tactile, visual, 
vestibular, etc. 

2) The familiarity of presentation of the information provided to each sen- 
soiy modaliQr. This might be measured subjectively, or measured via 
learning times. 




(5.1. 5.2) 
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Fipure A.2: Circuit Diagram 




Figure A.3: Circuit Diagram, continued 




Fi gure A.4: Circuit Diagram, continued 



Reference 


Manufacturer 


Part Number 


DescrfiTticn 










J1.J2.J3 






Connector. Banana. Female 


J4 






Connector, s-pin D 


J5.J6 






Cohhector. Audio 










SI 






Switch. DPDT 










U1 


Intersil 


ICL6038CCPO 


Function Generator 


U2 


Texas Instnjments 


TL084CJ 


Quad 6t-FET oo-amo 


U3 


Analog Devices 


AD539JN 


Analog multiplying chip 


U4.U5 


National Semi. 


LM12CLK 


Power AmpGlier 










D1,D2.D4.05 


Archer 


276-1101 


Diode, SlOoon, 50 V, 1 A 


D3 


Archer 


276-033A 


LED. red. 2 V. 20 mA 










K1 






Spadrtg post & screw 










R1.R16.R17 






Pot.. 0-5 Ml. 15-tUi7J 


R2 


Archer 


271-342 


Pot.. 0-1 kQ. 15-tum. cermet 


R12 






Pot.. 0-10 kfi. iS-tum 


R10.R11 






Resistor, 100 ka 


R18 






Resistor. 680 £2 


R3.R13.R19-R21 






Resistor. 1 ka 


R4-R9 






Resistor. 10 ka 


R14.R15 


Archer 


271-080 


Resistor. 100. 2 W 










Cl,C2.C3,C4 


Archer 


272-957 


Capacitor, 470 mF, electrolytic 


C7,C8,C10.C11 


Archer 


272-1433A 


Capacitor, 0.47 mF, tantalum 


C5.C6 






Capadtor. 10 mF. ceramic 


C9 






CaDadtor. 3 nP. oerairic 


C12 






Caixacitor. 0.1 mF. ceramic 










Mot numbered 






Perf board. 6 x 4.5 inches 










Not shown 






Socket. 14-frin DIP 








(useatU1.U2) 










Not shown 






Socket. 16-pin DIP 








(useatUS) 



Note: All resistors 1/8-watt, unless specified 



Table A.1: Electronic Parts List 
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* convonems removed to enclosure 



Figure A.5: Circuit Board Layout Diagram 
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Figure A,6: Gain Characteristics of th e Analog Electronics Unit 
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Vd/a 






g = l.o 


g = i.5 


g = 2.o 


g = 2.5 








R(»O.Oka 


Rf s 0.5 ka 


Rfsl.Okfi 


Rf«1.5kn 


0.0 






0.01 


0,01 


0.02 


0.02 


0.5 






0,37 


0.55 


0.74 


0.92 


1.0 






0.73 


1.11 


1.48 


1.85 


1.5 






1.1 


1.67 


2.22 


2.79 


2.0 






1.47 


2.22 


2.97 


3.74 



Table A.2: Gain Characteristics of the Analog Electronics Unit 



B Software Documentatioli 



Bl Hardware-Testing Code 
adtest.c 

/* 

A/D teat program 
Nicholas Patrick. 
November 21, 1989 

to sample the 16 A/D inputs vithout using DMA 

™ */ 

iinclude <stclio.h> 
finclude " . . \h\xnfitby te . h" 
iinclude <conio,h> 

eactern void ioinit_16()f 
extern dtoa () ; 

int data [10 ], Chan; 

main ( ) 
( 

char key "0; 
ioinit__16() ; 

printf ("XnXnVnXnXnXnXnXnXnXnNnXnXt") ; 

printfC ADTEST Version 1,0 Novenjber 21, 1989\n\n") ; 
printf ("Xt Hit any key to sample hand, 'Esc' to quit"); 
printf ( •« XnXnXnXnXnXnXnXnXnXnXn " ) ; 

while ((key«getch()) !« 27) { 

for(chan « 0; chan <«7; chan++) I 
atodO ; 

printf {-%6 . 4d",data [chan] ) ; 

1 

printf ("XnXa "); 
» 

) 

/* */ 

atodO 
( 

int lo,hi,ch> 

ch - (chan - (chan«4) ) ; /* start and stop at chan */ 
outp (ADMUX, ch) ; /* inform MUX of channel */ 



outpCADiiOrOxOO) ; /* start conversion */ 

while (inp (STATUS) & 0x40) /* wait for conversion to finish */ 



lo - inp(ADLO); /* read both bytes */ 

hi - inp(ADHI); 

if (do & OxOF) Chan) printf("\n\a chan is incorrect"); 
data [Chan] - ((((lo»4) C OxOF) + (hi«4)) t OxOFFF) ; 

I 

/* 

void ioinit_16() 
( 

/* clear the control register, and */ 
outp (CONTROL, OxbO) ; 

) 



datestZ.c 

/* 

0/A test program #2 
Nicholas Patrick 
December 4, 1989 

^ 

finclude <stdio.h> 
♦include . \h\inetbyte.h" 
iinclude <conio,h> 

void vout (float); 

void ioinit (void) ; 

void printjgreeting (void) ; 

mainO 
( 

float v - 0*0; 
float resp » 0.0; 
int j - 0; 

ioinit 0 ; 
printjgreeting () ; 

while (1) ( 

printf (••\n\t\a Enter voltage (0 to 2 V) , enter 9 to quit:"); 

scanf ("%f", &resp); 

if (resp «= 9.0) break; 

vout (resp) ; 

I 

/* return output to 0 volts */ 

printf ("\r\a\a\t D/A at 0 volts. \n\n\n") ; 

vout(O); 

\ 

/.^ ^ ^/ 

void vout (v) 
float v; 
( 



86 



int value; 



/* braclcet v between 0 and 2 volts */ 
if (V < 0.0) V - 0.0; 
if (V > 2.0) V - 2.0; 

/* convert v to d/a units */ 

value - v * (4096.0/5.0); 

if (value > 4095) value - 4095; 

/* send out left- justified vord to chan 0 */ 
outp(DA0LO^ (value«4) 6 OxFO); 
outp(DAOHI, (vaiue»4) k OxFF) ; 

/* send out left-justified word to chan 1 */ 
outp(DAlU), (value«4) « OxFO); 
outp(DAlHI, (value»4) & OxFF) ; 



/* — 

void ioinitO 
( 

/* clear the control register*/ 
outp (CONTROL, 0x00) ; 



return; 



/* 

void print^greetingO 
{ 

print f ("XnVnVnXnVnXnXnXnXnVnXnNnXnVnXt") ; 
printf (<* DATEST Version 2.0 December 4, 1989**); 
print f (^'XnXnXt For use with the prototype board") ; 
printf ("XhXnXnXnXnXnXnVnXnXnXn") ; 

return; 



B2 Experimentation code 
hands Lc 



/* ^ ^ 

Title; hand.c 

Author: Nicholas J.M. Patrick 

Info: Written for the Microsoft C Compiler Version 5.10 

Versions: 1-13 89.12.09 Initial development 

14 69.12.10 To be demonstrated for 2.737 

15 90.01.04 New index-finger calibration 

16 90.02.04 Modular finger-tip position calc's 

17 90.02.07 Multiple vibrotactile display coding 

18 90.02.18 Better writing of text to screen 

19 90.02.18 Single escape-sequence graphics 



20 


90.02.23 


21 


90.02.23 


22 


90.02.25 


23 


90.02.25 


24 


90.02.27 


25 


90.03.06 


26 


90.03.09 


27 


90.03.16 


28 


90.03.25 


29 


90.03.27 


30 


90.03.30 


31 


90.04.12 



Video-meznozy character graphics 
Loop counter « timer installed 
Sinuaoidally moving virtual plate 
Improved index-finger calibration 
Data recording and analyaia 
Snow-free display, 60 hertz timing 
write_file() for data recording added 
choices () module added 
video () graphics added using <graph.h> 
generally tidied up for testing 
get_scale added for setting screen scale 
extra visual displays, improved choices () 



finclude 
finclude 
i include 
finclude 
tinclude 
finclude 
finclude 
finclude 



<stdio.h> 

<conio.h> 

<stdllb.h> 

<graph.h> 

<math,h> 

<tiroe.h> 

<malloc.h> 

. \h\metbyte.h" 



f define VMAX 2.0 

f define Pi 3.14159 

f define MAXCOUNT 1800 

f define CAIi_DlST 50.0 

void vbut (int, float) ; 
void atod (void) ; 
void DAS16^inlt <void) : 
void video_init (void) ; 
void store_f igures (void) ; 
void shut-down (i At ) ; 
void print_jgreeting (void) ; 
void choices (void) ; 
void calibrate (void) ; 
void get_scale (void) ; 
float code (float); 
float thunibcalG(void) 7 
float indexcalc (void) ; 
void screen^clear (void) ; 
void analyze (void) ; 
void write^f ile (void) ; 
void video3 (float, float) ; 
void video2 (float r float) ; 
void videol (float, float); 
void videoO (void) ; 

int data [8]; 

float theta[8); 

int caldata(2] [8]; 

float slope [8]; 

float zeropos[2]; 

float Iil,li2,li3,ltl,lt2,lt3; 

float thick; 

float thiclcover2; 

int visijmode; 

int tact_mode; 

i n t reco rd_niode ; 

int ht_old, hi_old; 

int hpl^old, hpr^old; 



/* header file for KetraByte DAS-16 card */ 

* max voltage for AD539 mult chip (V) */ 

* should be obvious */ 

* maximum number of loops (30 sec) */ 

* calibration distance for calibrate () */ 



outputs voltage to chan. 0, 1 or both */ 
samples HandKaster sensors */ 
initializes KetraByte DAS-16 card */ 
init's graphics for visual display */ 
dravr and store video display figures ^/ 
outputs 0 V to both chants and exits 
prints greeting message */ 
user enters display settings */ 
returns finger geometry constants */ 
read and calculate screen_scale */ 
calculates display anplitude */ 
calculate thumb tip position */ 
calculate index finger tip position */ 
clears screen with ^\xlB(2J'* */ 
for post-run data analysis */ 
save record[][i to a disk file */ 
draw linear pursuit display */ 
draw non-linear con^. display */ 
draw on-off con^. to screen */ 
draw on-off comp. to screen */ 

/* 'live' raw sensor readings */ 

/* *live* sensor angles in radians */ 

/* raw sensor readings from calibrate */ 

/* joint -angle slopes */ 

/* just-touching positions of Th £ IF */ 

/* hand size variables */ 

/* virtual plane thickness 

/* half thickness for calculations */ 

/* visual display type */ 

/* tactile display type */ 

/* data-recording mode switch: 0, 1, 2 */ 

/* old finger-tip display coordinates */ 

/* old virtual plate display coord's */ 
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static float xecordlMAXCdUNT] 

float inean_inov_w; 

float inean_errjb; 

float ineanj8rr_ty 

float mean^err^i; 

struct videoconfig vc; 

char far *buffplateO; 

char far *buffplatel; 

char far *buffthuinbO; 

char far *buf f thuiobl ; 

char far *buffingerO; 

char far *buffingerl; 

float calfactor; 

int run_num; 

float screexi^scale; 

int timescale; 



/♦ 

void main (void) 
{ 

int resp, j# chan; 
float ptr pi# 
float di, dt, speed; 
long count; 

long tiine^on, time^off ; 
long cpuntmax; 

thick - 30.0; 
thiclcover2 « thick/2.0; 
countmax » KAXCOUNT; 



[3] ; /* array for data recording */ 
/* calc*d mean movement of plate thickness • 
/* calc'd mean error for both fingers */ 
/* calc*d mean error for thumb */ 
/* calc'd mean error for index finger */ 
/* video config. struct for video C) */ 
/* image of plate for erasing */ 
/* image of plate for drawing */ 
/* image of thumb for erasing */ 
/* image of thumb for drawing */ 
/* image of index finger for erasing */ 
/* image of index finger for drawing */ 
/* cal. factor produced by calibrate () */ 
/* sequence number of experimental run */ 
/* scale for video image, 1 - real size *l 
/* virtual plate change period in 1/60 s */ 

— */ 



/* fractional voltage output */ 

/* loop counter for timing */ 
/* loop start and stop tiroes */ 
/* max loop no. */ 

/* set virtual plate thickness */ 
/* calc this once to save time */ 
/* set to number in fdefine */ 



run_num « 0; 




DASie^initO ; 


/* 


print_greeting ( > ; 


/* 


calibrate () ; 


/* 


get^scaleO ; 


/* 


START: run num++; 





choices () ; 
if (record_mode 
if (visi^mode != 0) 

video_init () ; 

store_f igures () ; 
i^ (visijmode 0) 

videoO () ; 
count « 6; 
tiine(&time_pn) ; 



/* user enters settings */ 
0) run_num "0; /* reset run^num */ 

/* set up graphics video mode */ 
/* draw and store video figures */ 

/* draw still character to stare at */ 
/* reset loop counter to zero */ 
/* get starting time */ 



while (!kbhit() (count < countmax)) ( /* real-time loop */ 
atodO; /* sample DHM sensors */ 

if ( (count % timescale) 0) { 

thick = (30.0 + (float) (rand () % 50)); 

thickover2 « thick/2.0; 
J /* resize plate thickness once a second */ 



/* — The Th\imb — 
dt " thumbcalc.O; 
pt " code(dt)7 



.*/ 



/* calc. thusib tip position */ 
/* code touch for the thumb*/ 
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} 



/* — The Index Finger */ 

di - indexcaIcO; /* calc. index-finger tip position */ 

pi - codeCdi); code touch for index finger */ 

while ((inp(0x3DA} & 0x08) !- 0x08) 

; /* wait for 60 Hz video vert sync signal */ 

/* — The Displays */ 

/* draw thtunb 6 index tip positions to screen */ 
if (visi_mode 3) video3 (dt,di) ; 
if (visi^ioode — 2) vldeo2 (dt ,di) ; 
it (visi_raode ~ 1) videol (dt,di) ; 

if (tactjniode •« 0) ( 

vout (0,pt); /* vibrate thumb */* 

voutdrpi);* /* vibrate index finger */ 

/* — Record The Data ' */ 

record [count] [0] = thick; 
record [count] [1] « dt; 
record[count] [2] « di; 

count++; 

) 

tiiae(&tinie_off); /* get stopping time */ 

printf <-\a") ; 

yout(2r0,0); /* make sure displays are off */ 

if (visi^mode !» 0) ^setvideomode (_DEFAULTMODE) ; 
screen_clear ( ) ; 

if (count < countmax) getchO; /* absorb unwanted keystroke */ 

speed » ( float) count/ (float) <tirae_off ~ time_on) ; 
printf (••\xlB[04;20f Sanjsling rate was %.lf Hz*^ speed); 

analyze 0 ; 
write_file{); 

printf (••\xlB[15;20f Do you want to do another run ? (y/n)\n"); 
reap « getchO; 

if (resp !» «n* && resp !« 'N«) goto START; 

shut_down(P); /* shut down gracefully when a key is hit */ 



NAME: vout(chan^ p) 

INPUT: Chan « 0 or 1 or 2 (for both) 

p « fractional voltage between 0.0 and l.O 
RETURN: void 

EFFECT: puts out (p*Vinax) volts on channel 0 oi 1 of DAS-16 



void vout(xnt chan, float p) 
( 

int value; 
float v; 

/* convert portion p to voltage v */ 
V = VMAX * p; 

/* bracket v between 0 and VMAX volts */ 
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if (V < 0.0) V - 0.0; 
if (V > VMAX) V - VMAX; 



/* convert v to d/a units */ 
value - (int) (V ♦ (4096« 0/5. 0) > ; 

if (Chan «- 0 1 I chan — 2) { 

/* aend out left- juatif led word to chan 0 */ 

outp(DA0LO, (valtte«4) £ OxFO) ; 

outp(DAOHI, (value»4) C OxFF) ; 

1 

if (Chan — 1 | | chan — 2) ( 

/♦ aend out left- justified word to chan I */ 

outp(DAlX/>, (value«4) £ OxFO); 

butp(DAlHI, (value»4) « OxFF) ; 

» 

return; 

} 

/♦ 

NAME: DAS16_init (void) 

EFFECT: sets up HetraByte DAS-16 board for input « output 
. */ 

void DAS16_init(void) 
I 

outp (CONTROL, 0x00); /* clear the control register */ 

vout(2,0.0); /* make sure displays are off */ 

return; 

I 

~ 

NAMjB I video_init (void) 

EFFECT: seta graphics mode for high-res video display 
^ ...^^ 

void video^init (void) 
I 

if (^setvideomode (_HR£SBW) ~ 0) ( 

printf("\n _HRBSBW not supported. \n-) ; 
exit(O); 

I 

_getvideoconfig(£vc) ; 

_setlogorg (v.c«nunxpixels/2-lf vc.nuffiypixels/2-1) ; 
_clearscreen ( J5CLEARSCREEN) ; 

return; 

} 

NAME : store_f igures (void) 

EFFECT: draws and stores figures for video display 
*/ 

void store_f igures ( void) 
{ 

int i, j; 

/* blank vertical line for plate */ 

_setcolor (0) ; 
for (j— 6; j<-6; j++) ( 
_setpixel(0, j) ; 

) 

buffplateO - (char far *)malloc( (unsigned int)_imagesize(0,-6,0r 6) ) ; 



^getimage (Or-€r 0, €,bu££plateO) ; 

/* — — white vertical line for plate — — — — ~ */ 
_aetcolor (1) ; 
for (j— 6; j<-6; J-H-) { 
_9et pixel ( 0 , j ) ; 

) 

buffplatel - (char far *)nalloc( (unsigned int)_iiQagedize (0,-6,0, 6) ) ; 
jgetimage (Or -6, 0, 6, buffplatel) ; 

/* blank figure for thumb — */ 

_8etcolor (0) ; 
for (J— 2; j<-2; j-H») ( 
for (i-0; i<-4; i++) ( 
_setpixel (i, ; 

1 

) 

for (j— 1; j<-l; j-H-) ( 

for (i— 3; i<— 1; i++) { 
_aetpixel(i, J); 

) 

I 

buffthumbO - (char far *)inalloc( (unsigned int| JLinagesize(-3r-2r 4,2)) ; 
_getimage (-3, -2,4,2, buffthumbO ) ; 

/* ^ white figure for thumb */ 

_aetcolor (1) ; 
for (j— 2; j<-2; j++) ( 
for (i-0; i<-4; ( 
_setpi3cel(i, j); 

1 

} 

for (J— 1; j<-l; j++) ( 

for (i— 3; i<— 1; i++) { 
^setpixeKi, j); 

) 

1 

buffthumbl - (char far *)roalloc ( (unsigned int)_imagesize (*3, -2, 4,2) ) ; 
jgetimage (-3,-2,4,2, buffthumbl ) ; 

/* blanJc figure for index finger */ 

_setcolor (0) ; 
for (j— 2; J<-2; ( 
for (i-0; i<-4; i++> ( 
_setpixel(i,J); 

) 

) 

for (j— 1; j<-l; j++) { 
for (i-5; i<-7; i++) { 
_aetpixel(i, j); 

1 

I 

buffingerO - (char far *) malice ( (unsigned int)_iniage3ize (0,-^2,7, 2) ) ; 
_9etima9e(0,-2,7,2,buffingerO) ; 

/* white figure for index finger */ 

_setcolor(l) ; 
for (j=-2; j<-2; j++) { 
for (i-0; i<-4; i++> { 
_set pixel (i, j) ; 

1 

) 



for (J— 1; j<-l; { 
for (i-5; i<-7; | 
_setpixel (i, j) ; 

} 

J 

buffingerl • (char far *)iiialloc((unal9ned iiit)_iinage9ize(0,-2,7,2) ) ; 
jget image (0,-2^7,2, buff Inge r 1 ) ; " 

_clearscreen (JGCLEARSCREEN) ; 
return; 

I 

/* 

KAME : print^greet ing ( ) 

EFFECT: prXnta greeting mast to screen 

— . */ 

void print_greeting(void) 
I 

int ch; 

screen^clear () ; 

printf r\xlB[0B;20f HAND version 31 1990 April 12«*) ; 

printf ("\xlB[10;20f Nicholas J.M. Patrick**); 

printf (**\xlB[14;20f Hit •Bsc* to quit, any other key to start"); 

ch - getchO ; 

if (ch — 27) shut_down(0); 
return; 

) 

/* — 

NAME: void choices (void) 

EFFECT: changes global display settings, etc. 

^ */ 

void choices (void) 
{ 

int ch; 
CHOICE: screen_clear () ; 

printf (*\n\n\n\t Choose display settings for rtm %d \n", run^num) ; 



printf ("\n\t\t VISUAL TACTILE ENTER \n"); 

printf ("\n\t\t linear penetration 1"); 

printf CXnVtXt linear on-off 2"); 

printf ("VnXtXt linear x 3"); 

printf CVnYtNt penetration x 4"); 

printf (-\n\t\t on-off x 5-); 

printf (-\n\t\t x penetration 6"); 

printf (-\h\t\t x on-off 7 \n") ; 



printf (""XnXt For practice, type the same digit 2x, then enter**) ; 
printf (**\n\t To record points, type same digit 3x, then enter**) ; 
printf (*'\n\t Enter 0 to quit Xn") ; 

scanf (**%d**,6ch) ; /* read character input */ 

if (ch — 0) 3hut_down(0) ; 

else if (ch — 1 | | ch 11 I I ch ~ 111) ( 

visi^mode 3; 

tact^mode •2; 

} 

else if {'zh 2 | | ch 22 | | ch ~ 222) { 
visi^mode « 3; 
tact_mode 1; 
1 



else if (ch — 3 M ch ~ 33 I | ch — 333) { 
visi^mode 3; 
tact_inode * 0; 
I 

else if (ch — 4 I I ch — 44 | | ch — 444) { 
visi_inode - 2; 
tact_inode « 0; 
I 

else if (ch — 5 1 1 ch »- 55 M ch — 555) ( 
viaijnaodo - 1; 
tact^inoda - 0; 
) 

else if (ch 6 II ch — 66 1 1 ch — 666) ( 
viai^mode - 0; 
tact^jQOde "2; 
1 

else if (ch «- 7 || ch — 77 1 1 ch — 777) ( 
visi^mode • 0; 
tact_8iode ^1; 
I 

else goto CHOICE; 

if (ch < 10) record_mode "1; 
else if (ch > 100) recordjnode - 2; 
else record^inode — 0; 

printf ("\a"); 

/* return to main routine at user's pleasure */ 

printf (•\n\t Hit any key when ready to begin, n to reenter**) ; 

ch - getch.O ; 

if (ch » 'n* II ch • 'N') goto CHOICE; 

screen^clear () ; 
return; 



NAME: atodO 
INPUT: void 
RETURN: void 

EFFECT: changes the contents of the global array 'data[] * 

^ */ 

void atod(void) 
C 

int lo, hi, ch,^ chan; 
extern int data[]; 

for (Chan •« 0; chan <- 7; chan+4>) ( 

ch - (chan + (chan«4)); /* start and stop at chan */ 

outp(ADM(nc,ch); /* inform MUX of channel */ 

outp(ADI/),0x00) ; /* start conversion */ 

while (inp (STATUS) 40x40) /* wait for conversion */ 

; 

lo - inp(ADLO); /• read both bytes */ 

hi - inp(ADHI); 



if (do & OxOF) !- Chan) printf ("XnXa chan is incorrect"); 
data (Chan] » ( C ( (lo»4) & OxOF) + (hi«4) ) & OxOFFF) ; 



retucii; 

/* 

NAME: 9hut_down (int error) 

^ INPUT: error; a nusaiber showing error atatus 

EFFECT: puts out 0 volts on both DAS-'IC channels and aborts 

void shut dowhCint error) 
( 

/* putput 0 volts to both channels, then exit */ 
vout (2,0,0) 7 

printf ("\xlB[17;20f\xlBt5m Turn off Electronics ! \xlBCOm\n") ; 
exit(O); 

) 

/* . 

NAME: calibrate (void) 

EFFECT: changes globa'^s: caldata[], alope[], li*s. It's, lb, 
and zeropos [ ) . 

. • • */ 

void calibrate (void) 
{ 

int j, resp; 

float li, dl, d2, d3; 

calfactor * 1.0; /* initialize, so it won"t wreck calibration */ 

screen_jclear <) ; 

printf ("\xlBi04;10f Calibration for thunib and index finger. ..*') ; 

/* calc finger-segment lengths, scaling factors from author's hand */ 
printf C'VxlBtOGjlOf Enter length of index finger (mm) "); 
scanf ("%f-, fill); 
printf ('•Va*'); 

111 - li * 45,0/104.0 

112 - li * 23.0/104,0 
lis - li * 20, 0/104,0 
Itl « li * 20.0/104.0 



lt2 - li * 35.0/104,0 
lt3 - li * 20-0/104.0 



/* calc apprc index-finger lengths */ 
/* calc approx thusib lengths */ 



/* get 0*deg readings for th. & i.f., store in caldata[0] ( j] */ 
printf C'XxlBIOT/lOf Hold hand flat, thumb baclc & level (0 angles)*"); 
printf ("\xlB[08;14f Hit 'space" when ready"); 
resp - getchO ; 
atodO ; 

printf ("Xa") ; 

if (reap ~ 27) shutjdown(O) ; 

for (j » 0; j <«- 7; j++) /* save zero angles for i.f, */ 
caldataCOJ [j] -data[jl; 

/* get 90-deg readings for thumb 0, store in caldata[l] [0] */ 
printf (**\xlB[09;l0f Point thumb down at the ground (90 degrees)**); 
printf (••\xlBtlO;14f Hit <space< when ready-); 
getchO ; 
atodO ; 

printf CXa"); 

caldatad] [0] - data[0]; /* save 90 deg angle for thumb jO */ 
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/* get 90-deg readings for thumb 1, store in caldata [1] [1] */ 

printf ("\xlBtll;10f Hold the thumb alongside the index finger"); 

printf (-\xlB[12;14f Hit *space* *fhen ready"); 

getchO; 

atodO; 

printf (-\a"); 

caldatadl [1] - data[l]; /* save 90 deg angle for thumb jO */ 

/* get 45-deg readings for index finger, store in caldata [1] [j] */ 

printf ("\xlB(13;10f Hold each index-finger joint at 45 degrees"); 

printf {"\xlB(14;14f Hit • space « when ready"); 

getchO; 

atodO; 

printf <"\a"); 

for (j - 6; j <- 7; /* aave 45-deg angles */ 

caldatatl] Ijl - datalj]; 

/* get 90-deg readings for index joint 5, store in caldata[0] [5] */ 

printf {"\xlB(15;10f Hake a fist: index finger 5 at 90 degrees"); 

printf ("\xlB(16;14f Hit 'space* when readt/") ; 

getchO; 

atodO; 

printf ("\a"); 
caldata[0] [5] -data[5]; 

/* calculate slopes for joint angle calculations */ 

slopelS] - 4.0*(caldata(01 15J-caldata[ll [5))/PI; 

for <j - 6; J <- 7; j++) /* calc, slopes for i.f. */ 

3lope[jl - 4.0* (caldatatl] [j]-caldata[0J tjl 
for (j - 0; j <- 1; j++) /* calc, slopes for thumb */ 

slope[j] - 2.0* (caldata [1] [j]-caldata[0] [j]) /PI; 

/* get zero pos's for thumb & index finger, store in zeropos[l */ 
zeropos(01 - 0.0; /* make sure these start out at zero */ 

zeropos[l] - 0.0; 

printf ("\xlB[17;10f Make a flat 'OK' sign (touching positions)"); 
printf ("\xlB[18;14f Hit "space' when ready"); 
getchO ; 
atodO; 

printf ("\a"); 

ze ropes [ 0 ] -> t humbcalc ( ) ; 

zeroposil] » indexcalcO; 

/* return to main routine at users pleasure */ 

printf ("\xlB(19;10f Grip calibration piece between fingers."); 

printf ("\xlB[20;14f Hit any key when ready, "Esc' to quit."); 

getchO; 

atodO; 

printf ("\a"); 

calf actor » CALJ>IST/ (thumbcalcO + indexcalcO); 

/* return to main routine at users pleasure */ 
printf ("\xlB[21;10f Calibration calculations complete."); 
printf ("\xlB[22;14f Hit any key when ready, 'Esc' to quit."); 
reap » getchO ; 

if (resp — 27) shut_down(0) ; 

screen_clear () ; 

return; 

) 

/* 

NAME: void get_acale (void) 

EFFECT: reads scale from INPUT. INP & calculates screen scale 



„- — ^ »/ 

void get_jscale (void) 
I 

float acale; 
FIIiB *fp; 

screenjcleAr ( ) ; 

if ( Cf p-f open ( "input. inp"^-r-)) ~ NULL) { 

printf {"\xlBtl2;10f Couldn't open INPUT. INP") ; 
exit(0); 
I 

fscanf (fp, "%f, %d, *!, fiacale, atiinescale).; 

screen^acale - scale * 216*0/77.0; 

/* on the acreen there are about 3 plxela/mm */ 
f close (f p) ; 
acreen_clear () ; 
return; 

1 

/* 

NAME: float code (float d) 

INPUT: d " finger distance r thickness 

RETURN: p - fractional dislpay aziplitude 

. */ 

float code (float d) 
( 

float p; 

if (tactjnode — 1) I simple on-off coding */ 

if (d <^ (thickover2) ) p - 0,i5; 
else p » 0.0; 

) 

else if (tact_mode ~ 2) ( /* penetration coding */ 
if (d <- (thickover2) ) ( 

p - 0.5 + 0.5*((thickover2)-d)/10.0; 
if (p > 1.0) p - 1*0; 

) 

else p » 0.0; 

) 

else p ■> 0.0; 
return p; 

> 

/* 

NAME : thunibcalc (void) 

INPUT: 

RETURN: . dt - thumb tip position in mm 

*/ 

float thumbcalc (void) 
( 

float dt; 
int j; 

/* calculate thuznb angles in radians */ 
for (j - 0; i <- 1; J++) 

thetaCji - ((data(jl-caldata[0] [j])/slope[j) ); 

/* calculate thumb height in ism */ 

dt * (ltl-flt2+lt3)*sin((PI/2.0)*theta[l])*cos(0.5*thetaC0i); 
dt = (dt - zeropostO)); 



dt - dt*calfactor; * 
return (dt) ; 

I 

/* 

KAME : Indexcalc (void) 

INPUT: 

RETURN: di - index-finger tip position in mm 

float indexcalc (void) 
( 

float di, dl, d2, d3; 
int j; 

calculate index, finger angles in radians */ 
theta[5] - (PI/4.0) + ( (data(5J-caldata(l] [5) ) /3lope[5J ); 
for (j - 6; J <- 7; j++) 

thetaljl - ((dataljI-caldata[0Hj])/3lopeIjJ ); 

/* calculate index finger height in mm */ 

dl - lil * cos(theta[S]); 

d2 - 112 * cos(theta(5]+theta(€]); 

d3 • 113 * cos(theta[5]-i-theta[6]+theta[7]); 

di - dl + d2 + d3 - zeroposU]; 

di - dl *calf actor; 



return (di) ; 

I 

/*— ~ 

NAME: void screen^clear (void) 

REMARKS: uses ANSI, SYS escape sequence to clear screen 

. */ 

void screen^clear (void) 
( 

printf CVxlBiaj*); 

) 

/* 

NAME: void analyze (void) 

REMARKS: calculates abs-xoean error after run 

. */ 

void analyze (void) 
{ 

int j; 

float mov_w, err_t, err_i; 
float suni_inov «• 0.0; 
float sura_t - 0,0; 
float s\ixn_i « 0.0; 

for (j - 0; j < MAXCOUNT; j++) ( 

/* calculate sum target moveioent */ 

if (j > 0) /* do only after zeroth record */ 

inoyjw - (float) fabs (record [ j] [0] - record! j-l] [01 ) ; 
sujnjnov - sum_niov + moyjw; 

/* calculate error and sum for thuznb */ 

err_t - (float) fabs ( (record! j] [0] /2.0) -record[j] [1] ) ; 

8uni_t «" sum_t + err_jt; 

/* calculate error and sum for index finger */ 

err_i - (float) fabs ( (record[j] [0] /2.0) -record[j] [2] ) ; 



sum i •=» sum i + err i; 



mean_inov_w = 60 . 0*3um_mov/ (float) MftXCOUNT; 
mean_err_t « surn^t/ (float) MAXCOUNT; 
mean_jerr^i = sum_i/ (float) MAXCOUNT; 
mean err b ■= mean err t + mean err i; 



/* mean plate movement */ 
/* errors for thumb */ 
/* errors for index fgr */ 
/* errors for both fgrs */ 



printf ("XxlBCOe^-ZOf Mean errors: b: %6.3fr tz %6.3t, i: %€-3f"r 

mean^err^b, mean_err_t, mean^err^i) ; 
printf (•'\xlB[09;20f roean_jaovjM - %6.3f, normalized mean « %.5f"r 

roean_jnoyjw, mean_err_b/mean_movjw) ; 

return; 



} 



NAME: void write_f ile (void) 

REMARKS: writes the array record [] [] to a file 



void ipfrite_£lle (void) 
{ 

FILE *fp; 
int in- 
struct tm *newtime; 
char *am_pm « "pm"; 
time_t long_time; 

time (&long_time) ; 

newtime = localtime (&long_time) ; 

if (newtime->tm_hour < 12) 

am_j5m » •'am"; 
if (nevtime->tm_hour > 12) 

newtime->tm^hour -=12; 

if (recordjnode ««= 0) 

fp " £open("* junk.dat**r "a"); 
else fp « fopen("runl.dat*', "a"); 



/* variables for file */ 
/* variables for time */ 

/* calculate time and date 



/* open junJc file */ 
/* open good file */ 



if (rxm^num 1) { 

fprintf (fp^Tile: XnSubject's name: Xn"); 

fprintf (fpr^'Time and Date: %.19s %s\n*«,a3Ctime (newtime) ,am_pm) ; 
fprintf (fp, "Thumb, index, both, mean^mov, norm_err \n"); 

) 

fprintf (fp, "\nRun # %d, run_niim) ; 

fprintf (fp, "visi^jnode " %d, visi_mode) ; 

fprintf (fp, "tact_jtiode = %d, \n", tact^mode) ; 

fprintf (fp,"%6.3f, %6-3f, %6.3f", meanjerrjt, mean_err_i, meanjerr_J>) ; 
fprintf (fp, %€.3f, %.5f", mean_mov_w, (mean_err_b/mean_mov_w) ) ; 

if (record^mode = 2) { 

fprintf (fp, "\n\nthick, dt, di;\n"); 
for (i = 0; i < HAXCOONT; i++) ( 

fprintf (fp,"%5,2f, record[i] [0] ) ; 

fprintf (fp,-%5.2f, record [i] (1] ) ; 

fprintf (fp,*«%5*2f;\n-, record [i] [21 ) ; 

1 

fprintf (fp, "\n end of run %d \n", run_num) ; 

) 

fprintf (fp,"\n«); 
f close (fp) ; 



99 



if (record_mocie = 0) 

printf ("\xlB[13;20f Practice has been thrown into ' junk.dat • ") ; 
else 

printf (''\aclB[13;20f Rim %d has been added to • runl.dat ' run^niim) 



return; 

) 

/* 

NAME: 
REMARKS: 



void videos (float dt/ float di) 
draws linear pursuit visual display 



/* thumb is 7 pix wide */ 



void video3 (float dt^ float di) 
{ 

int ht, hi, hpl, hpr; 

/* erase old picture */ 

_j>utiniage (ht_old-7, -i2,buf fthxinODOr jGPSET) ; 
_putimage (hl_oldf -2,buf finger 0,jGP SET) ; 
j)ut image .(hpl_old, -6, buf f plateO , jGPSBT) ; 
^putimage (hpr_pldr buf f plateO , jGPSET) ; 

/* calculate new image locations 

ht = -l*(int) (dt*screen_scale) - 2; 

hi = (int) (di*screen_scale) + 2; 

hpl « -1* (int) ( (thickover2) *screen_scale) ; 

hpr « (int) ( (thic)cover2) *screen_scale) ; 

/* — ^ — draw new picture */ 

jputimage (ht-7 , -2 , buf f thumbl , _GPSET) ; 
_putimage (hi, -2rbuf f ingerl, jGPSET) ; 
_put image (hpl, -6,buf fplatel, jGPSET) ; 
_putimage (hpr, -6,buffplatelr JGPSET) ; 



*/ 
/* 
/* 
/* 
/* 



adjusted by 2 pixels * 
adjusted by 2 pixels * 
left edge of plate */ 
right edge of plate */ 



/* thtamb is 7 pix wide */ 



/* save old image locations — 

ht_old = ht; 
hi_old « hi; 
hpl^pld «= hpl; 
hpr^old = hpr; 



return; 

> 

/* . 

NAME: void video2 (float dt, float di) 

REMARKS: draws non-linear compensatory visual display 

^ ^ , */ 

void video2 (float dt, float di) 
{ 

f define LIMIT 20 . 0 
fdefine SIZE 30.0 
int ht, hi; 

int hpl « (int) (-SIZE*screen_scale) ; 
int hpr = (int) ( SIZE^screenjscale) ; 

/* erase old picture */ 

_putimage(ht_old-7,-2,buffthurobO,_GPSET); /* thumb is 7 pix wide */ 
Jputimage (hi_old, -2 , buf finger 0,J5P SET) ; 

/* — calculate new image locations */ 

if (dt < (thiclcover2-LIMIT) ) dt « (thic)cover2-LIMIT) ; 
if (di < (thickover2-LIMIT) ) di « ( thick:over2 -LIMIT ) ; 
if (dt <« thickover2) 
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ht = (int) (screen_3cale* (*SIZE + (thic1cover2-dt) ) ) ; 
else ht « -1000; 
if (di <» thick:over2) 

hi = (int) (screen_3Cale* ( SIZE - (thic)cover2-di) ) ) ; 
else hi « 1000; 

/* draw new picture */ 

_putiinage(ht-7,-2rbuf fthuinbl, jGPSET) ; /* thuxnb is 7 pix wide */ 

_putimage (hi, -2, buf f ingerl, JGPSET) ; 
_pu t image (hpl^ -6,buf fplatelr_GPSET) ; 
^utixnage (hpr, -6, buf fplatel^ JGPSET) ; 

/* save old image locations */ 

ht_pld = ht; 
hi_old -= hi; 

return; 

) 

/* 

NAME: void videol (float dt, float di) 

REMARKS: draws on-off compensatory visual display 

*/ 

void videol (float dt, float di) 
{ 

int ht, hi; 
int hpl = -30; 
int hpr *= 30; 



/* erase old picture */ 

_putimage (ht_old-7, -2, buf f thumbO, JGPSET) ; 
_putiinage (hi_old^ -2 , buf f ingerO , JSPSET ) ; 



/* thumb is 7 pix wide */ 



/* calcixlate new image locations — — */ 

if (dt <= thic]cpver2) ht » -20; 
else ht « -1000; 

if (di <« thickover2) hi « 20; 
else hi - 1000; 

/* — draw new picture */ 

_putimage (ht-7^ -2, buf f thurobl ,_GPSET) ; 
j>utimage (hi, -2, buf f ingerl , jGPSET) ; 
^utimage(hpl, *-6,buf fplatel, jGPSET) ; 
^utimage (hpr, -6, buf f platel, JSPSET) ; 

/* save old image locations — */ 

ht_old = ht; 
hi old = hi; 



/* thumb is 7 pix wide */ 



return; 

} 

/* ™ 

NAME: void videoO(void) 

REMARKS: draws on-off conpensatory vijual display 

void videoO(void) 
( 

screen_clear ( ) ; 

printf (''\xlB[ll;39f X"); 

return; 

/* END OF FILE */ 
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inputdnp (two versions) 

60r60r (to change plate thickness at 1.0 Hz) 

or 

60rl20, (to change plate thiclcness at 0.5 Hz) 



methyte.h 

/* ' 

netbyte.h 

1/29/89 
W. Durfee 

Include file for metbyte library functions. Defines Metrabyte DASH-16 
board port locations and some utility function macros. Declares 
non-integer functions in library. See Metrabyte manual for details. 



/* Base port address of Metrabyte Dash-16 card. */ 



fdefine BASE 0x300 



/* Dash-16 registers. */ 



fdefine 
fdefine 
fdefine 
fdefine 
fdefine 
fdefine 
fdefine 
fdefine 
fdefine 
fdefine 
fdefine 
fdefine 
fdefine 
fdefine 
fdefine 
fdefine 



ADLO 

ADHX 

ADMUX 

DIGOOT 

DIGIN 

DAOIiO 

DAOHI 

DAILO 

DAIRI 

STATUS 

CONTROL 

CTRENAB 

CTRO 

CTR2 
CTRCTRL 



(BASE-l-OxOO) 
(BASE+OxOl) 
(BASE-I-0X02) 
(BASE+0x03) 
(BASE+OxOS) 
(BASE+0x04) 
(BASE+OxOS) 
(BASE+0x06) 
(BASE+0x07) 
(BASE+OxOS) 
(BASE+0x09) 
(BASE+QxOA) 
(BASE+OxOC) 
(BASE+dxOD) 
(BASE+OxOE) 
(BASE-fOxOF) 



/* Macro function to read counter 0. */ 
fdefine READCTRO inp (CTRO) + (inp (CTRO) «8) 
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C Eperimentai Results 



SubJ. 


trial 


V3+T2 


V3+T1 


V3 


T2 

m mm 


■ ■ 


A 

• * 


1 

1 


9 163 


9 812 


1 0 606 


90 '^lO 






2 


8 925 

W.« w fcw 


9 QQ*) 




1 w.w 1 w 






3 


9 979 

W* W f w 


10 41 1 


1 1 ^^66 


1^ OA!^ 


1 0. f 0 1 




4 


7 107 

# • 1 w# 




1 I./ 90 








5 


10 556 


11 077 


10 OPQ 


1*^ O^d 




B 


1 

1 


9 438 


9 114 


9 027 
w«l/^ r 


10 570 


19 79Q 




2 


6 156 ' 

w« 1 WW 


7 326 


7 930 

f a^WW 


12 674 


11 '^AA 




3 


8 643 

M • W"TW 


7 274 


9 067 

w*vO / 


11 726 


19 6*^6 




4 


8.430 


7.909 


7.379 


11.283 


9.905 




5 


7 2J7 


8 086 

W*WWV 


9 233 

W«w WW 


11 111 

1 1 • 1 1 1 


12 638 

1 £«UWV 


C 


1 


7,366 


9.763 


6.609 


10.372 


9.383 




2 


7.584 


8.456 


8.301 


11.691 


12.682 




3 


6.617 


8.627 


8.080 


9.321 


11.280 










7.699 


1 1.37^ 


•4 «a fine 

1 0.605 




5 


6.416 


8.210 


8.704 


10.960 


12.116 


D 


1 


9.366 


8.348 


9.990 


11.232 


12.780 




2 


6.860 


7.297 


8.320 


11.065 


18.668 




3 


8.530 


8.498 


8.139 


11.037 


16.461 




4 


7.280 


6.284 


7.939 


10.135 


13.909 




5 


8.368 


9.274 


9.324 


10.156 


12.115 


E 


1 


11.885 


9.330 


12.015 


16.845 


13.018 




2 


11.477 


7.576 


9.334 


12.677 


14.735 




3 


12.179 


9.930 


12.598 


12.177 


13.464 




4 


10.105 


9.816 


9.931 


11.270 


12.528 




5 


8.429 


10.617 


11.987 


13.706 


14.987 


X 


(mm) 


8.619 


8.750 


9.486 


12.274 


15,249 


s 


(mm) 


1.699 


1.221 


1.667 


2.379 


5.270 


0/ Vn 


(mm) 


0.340 


0.440 


0.333 


0.476 


1.054 



Table C.1: Data from the Pieliminarv Trials 
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trial 


eb(nvn) 


Op (mm) 


mp (mm) 


eb/ep 


eb/mp 


©t 


e\ 


1 


6.042 


12.767 


13.740 


0.473 


0.440 


3.202 


2.840 


2 


6.922 


12.133 


15.720 


0.571 


0.440 


3.467 


3.455 


3 


7.664 


14.200 


16.680 


0.540 


0.459 


3.926 


3.738 


4 


6.176 


9.333 


12.960 


0.662 


0.477 


3.061 


3.115 


5 


8.117 


14.000 


19.140 


0.580 


0.424 


4.045 


4.072 


6 


7.492 


14.033 


16.980 


0.534 


0.441 


3.756 


3.736 


7 


9.492 


14.233 


19.380 


0.667 


0.490 


4.828 


4.664 


8 


8.253 


12.833 


18.480 


0.643 


0.447 


4.205 


4.048 


9 


8.247 


12.233 


15.120 


0.674 


0.545 


4.223 


4.024 


10 


7.958 


13.367 


17.220 


0.595 


0.462 


4.076 


3.882 


11 


7.085 


12.933 


15.240 


0.548 


0.465 


3.633 


3.452 


12 


7.655 


12.300 


17.100 


0.622 


0.448 


3.788 


3-867 


13 


6.649 


9.100 


14.520 


0.731 


0.458 


3.402 


3.247 


14 


7.971 


12.433 


16.860 


0.641 


0.473 


4.046 


3.925 


15 


6.769 


11.533 


14.280 


0.587 


0.474 


3.592 


3.177 


16 


5.522 


9.400 


11.700 


0.587 


0.472 


2.804 


2.718 


17 


7.436 


13.833 


17.040 


0.538 


0.436 


3.769 


3.667 


1 <> 




i o nnn 


1 fi nnn 
1 o.UUU 


U.D99 


n AIR 


QRR 


O.OOU 


19 


7.426 


11.433 


15.480 


0.650 


0.480 


3.775 


3,651 


20 


8.400 


13.033 


19.380 


0.645 


0.433 


4.208 


4,192 


CI 




1 1 .OOw 


1*9 QRn 


n i:7fi 
U.9 » o 


U.9 1 V 




3 323 


22 


8.381 


14.000 


19.140 


0.599 


0.438 


4.336 


4.045 


23 


7.301 


12.033 


15.060 


0.607 


0.485 


3.680 


3.621 


24 


7.332 


12.567 


17.340 


0.583 


0.423 


3.804 


3.528 


25 


6.069 


12.733 


13.080 


0.477 


0.464 


3.239 


2.830 




7.401 


12.412 


16.121 


0.599 


0.461 








0.903 


1.447 


2.199 


0.061 


0.028 


a 






12.2% 


11.7% 


13.6% 


10.3% 


6.1% 







Table C.2: Data from the Normalization Trials 
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trial 


en 


fingers 
together 


fingers 
apart 


finaers 
osciflating 


1 


10.49 


10.56 


4.54 


2 


8.23 


9.80 


3.66 


3 


6.56 


8.60 


4.31 


4 


7.21 


6.20 


3.74 


5 


7.00 


8.62 


4.20 


means 


7.9 


8.8 


4.1 



Table C.3i Maximum Attainable Normalized Errors 





thumb & index 


thumb 


index 


trial 


together: 


alone: 


alone: 




et/mp 


ei/mp 


et/mp 


ei/mp 


1 


0.215 


0.196 


0.209 


0.203 


2 


0.212 


0.209 


0.196 


0.200 


3 


0.222 


0.208 


0.187 


0.211 


4 


0.212 


0.209 


0.197 


0.194 


5 


0.213 


0.206 


0.191 


0.203 


6 


0.221 


0.213 


0.190 


0.194 


\^ 


0.2157 


0.2067 


0.1951 


0.2008 


o 


0.0045 


0.0057 


0.0078 


0.0064 


o/Vn 


0.0018 


0.0023 


0.0032 


0.0026 



Table C.4: Data from the Trials with Both & Individual Fingers 



Subl 


Bp 


V 


' Tp 


Subl 


Bp 


V 


TP 


F 


0.5214 


0.5764 


0.7599 


D 


0.5218 


0.5052 






0 5366 


0.6228 


1.0625 




0.5374 


0.6434 






0.4834 


0.5366 


0.9690 




0.5175 


0.5877 






0.5083 


0.5042 


0.8596 




0.5029 


0.5495 






0.5292 


0.4709 


0.7654 




0.5040 


0.5981 




• 


0.5476 


0.6024 


0.6799 




0.5357 


0.5523 






0.4853 


0.5406 


0.8049 




0.5204 


0.6022 






0.5329 


0.4553 


0.6938 




0.4614 


0.5565 






0.4671 


0.^091 


0.7944 




0.5213 


0.5363 






0.4375 


0.5207 


0.7488 




0.5082 


0.5529 






0.4932 


0.6013 


0.5907 




0.5466 


0.5208 






0.4811 


0.5742 


0.5964 




0.5306 


0.6655 




o 






0 5747 


A 


0.7300 


0.7202 


1.2042 




0 4365 


0.4246 


0.6402 




0.6497 


0.6390 


1.1032 




0.4369 


0.4428 


0.6583 




0.6347 


0.7272 


1.0654 




0 4102 


0.4372 


0.5632 




0.6770 


0.6229 


0.8577 




0.4444 


0.4441 


0.6083 




0.6214 


0.6582 


1.3320 




0 41i96 


0.4333 


0.5891 




0.6020 


0.6008 


0.8331 




0.3992 


0.4475 


0.6151 




0.6815 


0.5654 


0.9989 




0.4618 


0.4682 


0.6092 




0.6042 


0.6234 


0.9702 




0.4376 


0.4216 


0.5798 




0.6195 


0.6363 


1.1170 




0.4151 


0.4273 


0.6635 




0.5431 


0.5650 


0.7438 




0.4543 


0.4335 


0.5621 




0.4825 


0.5093 


0.8307 




0.4539 


0.4315 


0.5988 




0.5415 


0.5270 


0.7774 


c 


0.4995 


0.4703 






0.6009 


0.5549 


1 .0253 




0.5083 


0.5104 






0.5812 


0.5962 


1.0460 




0.5504 


0.5252 






0.6160 


0.5909 


1.1681 






U.400/ 










0.8792 




0.4836 


0.4551 






0.4960 


0.4887 


0.7621 




0.4916 


0.5027 






0.4768 


0.5837 


0.9213 




0.4747 


0.5031 






0.5396 


0.5628 


0.7592 




0.4416 


0.4317 






0.5169 


0.5227 


0.9770 




0.4187 


0.4475 






0.5331 


0.5503 


0.6654 




0.4475 


0.4282 














0.4201 


0.4363 






0.5174 


0.5339 


0.8004 




0.5150 


0.5213 




a 


0.0683 


0.0730 


0.1953 


G 


0.5207 


0.5116 


0.6565 


a/Vn 


0.0079 


0.008« 


0.0273 




0.5601 


0.5763 


0.6261 












0.5657 


0.5376 


0.6855 












0.5167 


0.5693 


0,6976 












0.5244 


0.5010 


0.6296 












0.5289 


0.5357 


0.9004 











Table C.5: Da ta from the Full-Displav Trials 



106 



suDject 


"2 


- Display - 
T2 Vi 


11 


B 


1.0145 


0.7784 


1.0000 


0.8956 




0.9421 


0.7833 


1.2640 


0.7109 




1 .21 38 


0.6877 


1.0126 


0.7640 




0.7740 


0.6523 


1.2464 


0.7226 




0.7435 


0.7697 


1.1880 


0.7805 


F 


1.0189 


0.9587 


1.3186 


1.0653 




1 .0904 


0.8969 


1.8459 


1.1632 




1.0540 


1.0909 


1.6736 


1.2634 




1.2146 


0.9096 


1.1685 


1.1367 




1 .2982 


0.8378 


1.5190 


1.1554 


G 


1.0686 


1.0652 


1.6962 


1.4213 




1.2883 


1.2650 


1.1858 


1.5620 




' 1.3316 


1.1460 


* 3.0202 


1.0577 




1.2637 


* 1.5012 


1.3417 


* 1.7127 




0.9409 


0.9325 


1.2289 


1.2505 


H 


1.0089 


0.7844 


1.2097 


0.8261 




0.9260 


0.8172 


1.0116 


1.1106 




0.8742 


0.7153 


1.0820 


0.9473 




0.8047 


0.8575 


1.2191 


0.9483 




0.8449 


0.7267 


1.1651 


0.9282 


B 


0.7868 


0.6713 


0.9653 


0.9532 




0.9773 


0.8509 


1.1909 


0 9091 




0.7906 


0.8087 


0.9653 


0.7409 




0.8110 


0.7997 


1 .0609 


0.8359 




0.9390 


0.6784 


1.8001 


0.8028 




0.9385 


0.6840 


1.0252 


0.7933 


H 


0.8704 


U./400 


1.1 OOO 


0.8183 




Q.o775 


0.7715 


1.4014 


0.7837 




0.6928 


0.7632 


1.0233 


0.7482 




0.8784 


0.6447 


0.9850 


0.7669 




0.8147 


0.6808 


1.1279 


0.8440 


max 


1.2982 


1.2650 


1.8459 


1.5620 


min 


0.6928 


0.6447 


0.9653 


0.7109 


removed 


1.3316 


1.5012 


3.0202 


1.7127 




0.9586 


0.8259 


1.2375 


0.9569 


a 


0.1675 


0.1531 


0.2460 


0.2184 


o/Vn 


0.0306 


0.0279 


0.0449 


0.0399 



* outlier removed 



Table C.6! Data from the Low-Information Display Trials 



Id (bits) 


Statistic 


Display Combination 


Reactive 
•I- Visual 


Tactile -i- 
Visual 


Visual 
Only 


3 




0.5750 


0.5850 


0.8300 


M 


a 


0.0727 


0.0436 


0.1060 


M 


ahjn 


0.0116 


0.0070 


0.0170 


n 


1 .645 o/Vn 


0.0191 


0.0115 


0.0279 


4 


»A 


0.6680 


0.7020 


0.9790 


•V 


a 


0.0967 


0.0663 


0.1080 


ft 




0.0155 


0.0106 


0.0173 


It 


1.645 a/Vn 


0.0255 


0.0175 


0.0284 


5 




0.9620 


1.1900 


1.7200 


If 


a 


0.1580 


0.2120 


0.3080 


« 


a/Vn 


0.0253 


0.0339 


0.0493 


N 


1.645 a/Vn 


0.0416 


0.0558 


0.0811 



* Periods in seconds; 40 trials per condition 
Table CJ.a: Results of Experimentation by Massimino 



Id 


Display 


% ciiange 


90% conf. 


(bits) 


Comparison 


in period 


limits 


3 


RV-TV 


-1.7% 


±3.8 % 




RV-V 


-30.7 % 


±4.0 % 




TV-V 


-29.5 % 


±3 . 6 % 


4 


RV-TV 


-4.8% 


±4.3 % 




RV-V 


-31.8% 


±3.9 % 




TV-V 


-28.3 % 


±3.4 % 


5 


RV-TV 


-19.2% 


±5.8 % 




RV-V 


-44.1 % 


±5.2 % 




TV-V 


-30.8 % 


±5.7 % 



Table C.7.b: Percentage Changes from Experimentation by Massimino 



lOS 



Factor: 


Factor 


Display 


Display 


CXsplay 


Display 




Display 


Display 




Weight 


V3+T2 


V3+T1 


V3 


T2 


V2 


T1 


VI 


Mental Demand 


0.133 


0.200 


0.300 


0.350 


0.500 


0.550 


0.600 


0.650 


Physical Demand 


0.067 


0.100 


0.100 


0.100 


0.100 


0.150 


0.250 


0.250 


Temporal Demand 


0.200 


0.500 


0.500 


0.500 


0.500 


0.600 


0.600 


0.700 


Perfonnahce 


0.267 


0.800 


0.600 


0.500 


0.550 


0.350 


0.350 


0.200 


Effort 


0.333 


0.300 


0.400 


0.500 


0.550 


0.600 


0.650 


0.700 


Frustration 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


0.000 


Combined Indices: 




0.287 


0.387 


0.453 


0.477 


0.577 


0.607 


0.690 


Trial Enors (mm): 


















Main (1.0 Hz) 




0.434 




0.439 






0.605 




IjOw Info (0.5 Hz) 










0.879 


1.156 


0.750 


0.842 


Combined (O^Hz) 




0.538 




0.543 


0.879 


1.156 


0.750 


0.842 



Table C.8: Subjective Comparison of Display Combinations 
(usinp NASA TLX> with Trial Errors 



